The best elegant solution to override 65k rows limit in a sheet

A

aaron.kempf

you're crazy man.. go play with your BILLION DOLLAR DATABASES if you
want.

MDB is free; but still crap-- much like Excel.

MSDE/ADP is a free stack for all practical purposes. It has a FREE
front end called the Access Runtime-- it is a dream platform. And it
scales a LOT better than MDB.. I am tired of MDB; it is too slow; and
it really shoudlnt' ever be used from a mapped network drive--
performance is just too slow to do that.

That's what drives me crazy about MDB.. performance is worse than most
excel spreadsheets.. but it is a lot more powerful.

MSDE is the most powerful database in the WORLD.

Steve Ballmer says that 50% of the seats in the WORLD are SQL Server.
I know for a friggin fact it's true, dude.. I've been to 30 companies
over the past 7 years; I've seen 1 AS/400 and a half dozen oracle
boxes.. and HUNDREDS of SQL Server or MSDE boxes.

MSDE is an AWESOME stack for workgroups. I love it-- I just know that
this is a better choice than MDB at this point. MDB-- MS hasn't made
any exciting innovations in Access MDB for 10 years; and it pisses me
off.. They could start by making more drivers native.

There are 2 practical options these days-- mySql and SQL Server..
Oracle and IBM are bleeding red right now; IBM is keeling over like
we've never seen.. Oracle finally realizes that they're screwed on the
server front-- their products aren't UNBREAKABLE like they claim.

And SQL Server-- Analysis Services against Office Web Components-- it
makes beancounters like you irrelevant.

And the point of the matter--- IT SHOULDN'T OWN DATABASES. IT CAN OWN
THE SERVERS; DEPARTMENTS SHOULD OWN THE DATABASES.

Databases are a free and lovely and wonderfully flexible solution--
it's just that IT doesn't know whats best for databases... You design
databases in your department; and then you hand them off to IT.

I'm sorry that you work for a stodgy company.

if you use MDB; dont ever do anything across a mapped network drive--
performance drives me absolutely batty.

And SQL Server is the most popular db IN THE WORLD DUDE.
 
S

Sum Yung Guy

And SQL Server is the most popular db IN THE WORLD DUDE.

Why don't you two take this to email?

And Aaron, if you don't want to help people (telling them to just use Access
isn't help,) just get out of this group.

Just my 2 cents.
 
J

Jay Petrulis

Sum said:
Why don't you two take this to email?

And Aaron, if you don't want to help people (telling them to just use Access
isn't help,) just get out of this group.

Just my 2 cents.

Noooo!!!! I agree with you 100% that Aaron's replies don't help, but
this is a trainwreck that happens over and over. Who would want to
miss that? Not I. :):):) Aaron posts garbage in other groups, too.
He is not around to help at all.

It is a good thing that Aaron doesn't use his real name, or else people
might think he is a kook. I think his real name is McArthur Wheeler...

http://www.phule.net/mirrors/unskilled-and-unaware.html
 
A

aaron.kempf

MDB/ADP is free, Access runtime.. Excel doesnt have a runtime, does it
lol

I dont believe that the governor is quite as strong as you thought. In
MSDE 1, it was a very rigid limit-- in MSDE 2 (SQL 2000) it is a lot
more relaxed.

sum young, go and play with your spreadsheets little kid.. access
trumps excel any day of the week. it is better to place your bets on
SQL Server than MDB.

woud you rather make a report once and run it with different
parameters; or cut and paste 10,000 rows around?

i mean seirously
 
H

Harlan Grove

(e-mail address removed) wrote...
MDB/ADP is free, Access runtime.. Excel doesnt have a runtime, does it
....

And you can create MDB or ADP databases using just the Access runtime?
woud you rather make a report once and run it with different
parameters; or cut and paste 10,000 rows around?

If one were making reports . . . but is making reports the only thing
you believe businesses do?
 
A

aaron.kempf

yes, making reports is all that you idiots do.

but you guys dont even know how to do it.

lol
 
A

aaron.kempf

what do you do, enter data into spreadsheets?

what a waste of time... i mean; there is no REAL validation in Excel
multiple users can't use Excel at the same time

what a joke.. i just cant' believe that you guys still actually use a
program that was passe in 1995.

-aaron
 
H

Harlan Grove

(e-mail address removed) wrote...
....
what a joke.. i just cant' believe that you guys still actually use a
program that was passe in 1995.

That's because you can't understand what anyone does who doesn't do the
grunt work you do.

Excel is overused to produce reports, but (as I've pointed out
repeatedly) if Excel is the only tool one has, it's the tool one uses.

It's safe to assume people who ask questions in Excel newsgroups have
Excel, so giving them suggested workflows in Excel makes sense. It's
*NOT* safe to assume they have Access or access to SQL Server (or have
physical access to an Office CD in order to install MSDE), so stating
that they should use Access and/or ADP doesn't always make sense. You
may not like that, but the universe (and the business world) don't give
a rat's backside what you like.
 
A

aaron.kempf

yeah.. you're right.. im so sorry..

i forgot.. you do all this complex math.. stuff that is WAY too complex
for a database lol

it's time to wake up kids.. Excel is a total PITA for many reasons:

a) 65k row limit
b) only single user functionality
c) lack of parameters
d) inability to have REAL data validation
e) it requires that you have formulas in hundreds of different cells
f) no real printing functionality
g) no real exporting functionality (Microsoft Document Imaging doesnt
count since they have changed standards after MDI into their 'real PDF
killer')
h) inability to reuse your applications.. you have to recopy your
spreadsheets

i just think that you kids need to start thikning of bigger and better
things to do with your time than to sit around and recreate the same
spreadsheet week in and week out.

You guys are a dime a dozen; you dont do real math.
you rely on a crippled application.. you build applications that are
more complex than they need to be-- because you guys are stuck in the
80s.

-Aaron
 
H

Harlan Grove

(e-mail address removed) wrote...
....
i forgot.. you do all this complex math.. stuff that is WAY too complex
for a database lol

OK, if it's so easy to do general math in databases, show us, Oh great
sage, how to generate all permutations of, say, 8 distinct tokens using
SQL queries.

Or show us how to calculate fitted coefficients of polynomial
regression curves.

Or how to calculate the FFT of time series data.
it's time to wake up kids.. Excel is a total PITA for many reasons:

a) 65k row limit

Only if you're misusing Excel as a database. There *are* things Excel
does poorly. Excel makes a much worse data store than databases. As
I've stated before, if you're using more than a few thousand rows, you
shouldn't be using Excel. If anyone needs data tables spanning more
than 65,535 records (yes, 2^16-1) *and* one doesn't have a database,
those tables should be stored in plain text files, and Excel should
fetch the data it needs from those files using MSFT Query or
SQL.REQUEST and the ODBC driver for text files.
b) only single user functionality

Depending on what one's doing, that may be what's wanted & needed. It
*IS* possible for multiple users to access *closed* XLS files as dumb
data stores. If one needs to perform calculations, it's not unlikely
different users would want to perform different calculations, so the
need for multiple user functionality isn't obvious. At least not when
using spreadsheets for what they're best at doing.

There's also the quibble that separate memory images on different
users' PCs of the same XLT or XLS file isn't all that much different
than separate memory images on different users' PCs of the same
temporary database tables.
c) lack of parameters

Here's you're demonstrating your ignorance. Well-designed spreadsheets
present users with screens (worksheets or user forms, aka dialogs)
prompting for parameters. There's also defined names and values loaded
from environment variables via Auto_Open macros or Workbook_Open
events.
d) inability to have REAL data validation

As in Data > Validation, agreed - that feature is WEAK! However,
there's always the old fashioned way - allow any users entries but use
formulas to validate those entries. A few defined names referring to
formulas that check for valid entries coupled with Change, Calculate
and Deactivate event handlers is all that's needed. It may require more
programming effort than database validation, but 'inability' is
incorrect.
e) it requires that you have formulas in hundreds of different cells

So? That's how spreadsheets work. It's not all that difficult to check
that all formulas in a given range have the same formula 'template',
i.e., that they're identical in R1C1 referencing mode. Formulas also
allow auditors to validate how every value in spreadsheet files other
than constants is produced.
f) no real printing functionality

Here you must mean reporting functionality with grouping and section
breaks. Agreed. Excel isn't ideal as a reporting tool. However, Excel
isn't used exclusively to generate reports even if your wee tiny brain
can't grasp what these other tasks might be.
g) no real exporting functionality (Microsoft Document Imaging doesnt
count since they have changed standards after MDI into their 'real PDF
killer')

See (f).
h) inability to reuse your applications.. you have to recopy your
spreadsheets
....

Depends on what you mean by reuse. The average Excel user may reinvent
the wheel over and over again, but more advanced Excel users have
libraries of Excel formulas and data structures that they can reuse
(yes, by copy & paste). There are also XLT template files. You may
consider XLS files generated from XLT files as multiple copies, but
sensible people would consider them necessarily multiple instances of
the same thing, in much the same way different programs would have
their own instances of object classes.

It's also possible to design Excel models to use shared, read-only XLS
files as black box back ends in conjunction with multiple instances of
template front end workbooks. It takes some nontrivial event
programming, but it's not impossible.
You guys are a dime a dozen; you dont do real math.
....

You do? Adding or subtracting billions of numbers is math, but it isn't
sophisticated, only tediously repetitious.

Have you ever generated descriptive statistics? Do you even know what
descriptive statistics are? Do you know how to model default or call
risk on corporate bond portfolios? Do you know how to perform what-if
analysis on project NPV using simulated variable factor costs and
market demand?

Or do you just know how to build queries like

SELECT *
FROM WhatAaronUnderstands;

and work with NULL results?
 
A

aaron.kempf

yeah i dont give a shit about those functions; since i haven't ever had
to use them.

how about this-- can you use the coalesce function in Excel?

give me cell A1, if its empty, give me A4, if it's empty give me B13,
if it's empty give me B37, if it's empty I65

can excel do that? NOT MORE THAN 7 LAYERS DEEP WITH UGLY ASS EXCEL
NESTED FUNCTIONS.

In SQL, it would be coalesce(A1, A4, B13, B37, 165)-- that easy

i know what some of those functions other; the other ones i dont give a
shit about.. since i know that i could easily write them
as UDFs on SQL Server.

templates aren't what im talking about. i dont want a billion copies of
the
same spreadsheet; each one changed 10%. it is ridiculous way to run a
company... I mean-- they actually PAY YOU DIPSHITS TO COPY AND PASTE
THE
SAME THING 100 TIMES??

Give me a break!!!

i just know that 90% of your math you could do in a database; and it
would
be:

a) faster
b) centralized
c) extensible
d) reliable
e) auditable (comparing 10,000 formulas ISN'T auditable)
e) secure

and the rest of this functionality that you're just DYING to use.. it
is
freely available as a UDF. Or easy to write as a UDF. it is easy to
use.
you can EDIT the functions if you need to..

the thing about Excel is that when something breaks; you have no
CONTROL
over it. Excel is too closed for my likings-- but I'm just more
worried
about flat out functionality. I mean-- multiple people can't use it.
You
have to buy sharepoint just to keep your ducks in a row-- it's just a
total
waste of time.

You can't LEVERAGE a bunch of spreadsheets.. you can search and hunt
and
peck through spreadsheets all you want.

but you can't have 100 users on a spreadsheet; editing numbers all day
long.

Excel can't even VALIDATE data. Excel is just pretty much a total and
complete waste of time.

And you guys sit around and you're too lazy to learn a real program. I
am
here to tell you guys that you all have NO PLACE in the workplace of
the
future. You guys aren't CERTIFIED. You guys dont push yourselves..
and you
dont' deserve to WORK. You guys aren't committed enough to turn on the
computer.

I go home and study SQL Server and VB and OLAP and PHP and mySQL.

And you guys jerk off and write the same spreadsheet week in and week
out.

ARENT YOU TIRED OF CUTTING AND PASTING?

DONT YOU WANT TO MOVE NUMBERS, RUN REPORTS AUTOMATICALLY?

The time is now to throw down Excel and throw out everything that you
know..
and start with the basics.

Learn SQL. Learn MDX if you really think that 'your math is too
complex'

it's just time for you guys to wake up to the 20th century and stop
living
in in 1995.. copying and paste just doesnt do the trick anymore.

Do you really need NINE DIFFERENT COPIES OF THE SAME DATA; SORTED IN
DIFFERENT WAYS? I mean-- for real.. get on with your life.

Don't you want ONE VERSION OF DATA and the ability to DISPLAY IT IN
MULTIPLE
FLAVORS?

SOOOOOOOOOOOOOOOOOOOOOO much more efficient than copying and pasting
lol

You guys just aren't HUNGRY ENOUGH. You oxygen that you breathe is
worth
more than what you get done.

I just know that SQL Server can do all the math that you need to do.
It
allows you MORE control; and it is easier to use.

-aaron
 
H

Harlan Grove

(e-mail address removed) wrote...
yeah i dont give a shit about those functions; since i haven't ever had
to use them.

And since Aaron has never had cause to use them, they serve no purpose
for anyone else?!
how about this-- can you use the coalesce function in Excel?

give me cell A1, if its empty, give me A4, if it's empty give me B13,
if it's empty give me B37, if it's empty I65

can excel do that? NOT MORE THAN 7 LAYERS DEEP WITH UGLY ASS EXCEL
NESTED FUNCTIONS.

You mean something like the more robust but long

=INDEX((A1,C1,E1,B2,D2,F2,A3,C3,E3,B4,D4,F4,A5,C5,E5,B6,D6,F6),1,1,
MATCH(0,
ISBLANK(A1)*{1;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0}-
ISBLANK(C1)*{0;1;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0}-
ISBLANK(E1)*{0;0;1;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0}-
ISBLANK(B2)*{0;0;0;1;0;0;0;0;0;0;0;0;0;0;0;0;0;0}-
ISBLANK(D2)*{0;0;0;0;1;0;0;0;0;0;0;0;0;0;0;0;0;0}-
ISBLANK(F2)*{0;0;0;0;0;1;0;0;0;0;0;0;0;0;0;0;0;0}-
ISBLANK(A3)*{0;0;0;0;0;0;1;0;0;0;0;0;0;0;0;0;0;0}-
ISBLANK(C3)*{0;0;0;0;0;0;0;1;0;0;0;0;0;0;0;0;0;0}-
ISBLANK(E3)*{0;0;0;0;0;0;0;0;1;0;0;0;0;0;0;0;0;0}-
ISBLANK(B4)*{0;0;0;0;0;0;0;0;0;1;0;0;0;0;0;0;0;0}-
ISBLANK(D4)*{0;0;0;0;0;0;0;0;0;0;1;0;0;0;0;0;0;0}-
ISBLANK(F4)*{0;0;0;0;0;0;0;0;0;0;0;1;0;0;0;0;0;0}-
ISBLANK(A5)*{0;0;0;0;0;0;0;0;0;0;0;0;1;0;0;0;0;0}-
ISBLANK(C5)*{0;0;0;0;0;0;0;0;0;0;0;0;0;1;0;0;0;0}-
ISBLANK(E5)*{0;0;0;0;0;0;0;0;0;0;0;0;0;0;1;0;0;0}-
ISBLANK(B6)*{0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;1;0;0}-
ISBLANK(D6)*{0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;1;0}-
ISBLANK(F6)*{0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;0;1},
0))

or the less robust but shorter

=INDEX((A1,C1,E1,B2,D2,F2,A3,C3,E3,B4,D4,F4,A5,C5,E5,B6,D6,F6),1,1,
MATCH(0,COUNTIF(INDIRECT({"A1";"C1";"E1";"B2";"D2";"F2";"A3";"C3";"E3";
"B4";"D4";"F4";"A5";"C5";"E5";"B6";"D6";"F6"}),"="),0))

And if the multiple area range were named foo, and the following names
were also defined,

seq
=ROW(INDIRECT("1:256"))

foo_tr1
=CELL("Address",foo)

foo_tr2
=MID(foo_tr1,SMALL(IF(MID(","&foo_tr1,seq,1)=",",seq),
ROW(INDIRECT("1:"&AREAS(foo)))),SMALL(IF(MID(foo_tr1&",",seq,1)=",",seq),
ROW(INDIRECT("1:"&AREAS(foo))))-SMALL(IF(MID(","&foo_tr1,seq,1)=",",seq),
ROW(INDIRECT("1:"&AREAS(foo)))))

then the formula above could be rewritten as

=INDEX(foo,1,1,MATCH(0,COUNTIF(INDIRECT(foo_tr2),"="),0))

It can be done, even without VBA.
i know what some of those functions other; the other ones i dont give a
shit about.. since i know that i could easily write them
as UDFs on SQL Server.

So prove it. You *CLAIM* to be able to do lots of things in SQL. You've
only ever shown a handful of poorly written and all too often incorrect
queries. It's difficult not to conclude you have no clue how to do much
of anything at all other than run reports no more complex than
balancing a checkbook.
templates aren't what im talking about. i dont want a billion copies of
the same spreadsheet; each one changed 10%. it is ridiculous way to run a
....

That's the point about spreadsheets you don't understand: LOTS of
calculations on little data. The ratio of formulas to entries is
usually over 10. In databases, it's seldom more than 2 operations per
field. Templates provide the common functions.
i just know that 90% of your math you could do in a database; and it
would be:

Well you lose right off the bat. While they ain't the best, I use
LINEST and LOGEST pretty heavily (linear and log-transformed linear
regresion).
a) faster

For simple stuff like SUM, COUNT, AVERAGE, etc., maybe. For something
like amortization tables, ain't so. The calculations wouldn't take much
different time in both, but the database approach would require
multiple queries run in sequence. The spreadsheet approach would only
require parameter entry.
b) centralized

Granted, but only beneficial if the data needed already exists in
centralized tables or the end user needing to enter data can update
existing tables or create new ones. Permissions to do so are a lot
rarer than you seem to believe.
c) extensible

Depends on what sort of extension one needs. There are COM add-in
interfaces between Excel and R and Mathematica. Where are the
counterparts for Access or SQL Server?
d) reliable

While the network is up & running. When the network goes down,
spreadsheet users can keep working, database grunts like you get to sit
on your thumbs.
e) auditable (comparing 10,000 formulas ISN'T auditable)

Yes, comparing 10,000 formulas is auditable. More so than reconciling
discrepancies between different database reports that use different
rounding schemes.
e) secure

e again? Oh that's right, database make it difficult to generate
arbitrary sequences of values. In Excel you could have put
=CHAR(96+ROW()) in cell A1 and filled down. You would have gotten "f"
in cell A6.

Security would be compromised big time if every user in a company could
update existing tables as you seem to believe they should be able to
do.

You can't have security *and* unrestricted access.
and the rest of this functionality that you're just DYING to use.. it
is freely available as a UDF. Or easy to write as a UDF. it is easy to
use. you can EDIT the functions if you need to..

Vacuous. Everything any software can do could be recreated using a hex
editor to create binary files containing machine code. The reason that
isn't too popular is because it's INEFFICIENT. Apparently you think
it'd be a good idea to reinvent all spreadsheet functionality not
provided by Access as udfs. You really do define CLUELESS.
the thing about Excel is that when something breaks; you have no
CONTROL over it. Excel is too closed for my likings-- but I'm just more
worried about flat out functionality. I mean-- multiple people can't
use it. You have to buy sharepoint just to keep your ducks in a row--
it's just a total waste of time.

Since you don't know spreadsheet basics, why would you expect to know
more advanced spreadsheet design? Control can be achieved, but it
requires more coding than databases. It's a tradeoff between
flexibility and control.
You can't LEVERAGE a bunch of spreadsheets.. you can search and hunt
and peck through spreadsheets all you want.

No, *YOU* can't do so because you don't have a clue how to use
spreadsheets.
but you can't have 100 users on a spreadsheet; editing numbers all day
long.

Granted. Spreadsheets aren't meant to be used for multiple concurrent
user data entry. That doesn't mean spreadsheets don't have their uses.
I wouldn't want to use Access to try to play CDs.
Excel can't even VALIDATE data. Excel is just pretty much a total and
complete waste of time.

It can, but it requires coding.
And you guys sit around and you're too lazy to learn a real program. I
am here to tell you guys that you all have NO PLACE in the workplace of
the future. You guys aren't CERTIFIED. You guys dont push yourselves..
and you dont' deserve to WORK. You guys aren't committed enough to turn
on the computer.

Again, you lack the capacity to understand that there are people in
most companies who get paid to do things you don't do. You're befuddled
into thinking everyone does what Aaron does. Ain't so. Most people are
paid to perform tasks that aren't specified in terms of what software
they need to use. "Sell N units of product X" doesn't necessarily
require either a spreadsheet or a database, but if salespeople aren't
given database apps in which to record their sales, they'll use what
*THEY* consider easiest.
I go home and study SQL Server and VB and OLAP and PHP and mySQL.

Oh goody for you. I go home an have a life.
DONT YOU WANT TO MOVE NUMBERS, RUN REPORTS AUTOMATICALLY?

Nope. Running reports would be a HUGE step backwards in my career. I
prefer to do what I'm doing or proceed on. To repeat: the only regular
reports I produce are expense reports.
You guys just aren't HUNGRY ENOUGH. . . .

More cluelessness. Most of the rest of us have left report generation
way behind. We do things you couldn't understand, so no point wasting
time trying to explain them to you.
 
A

aaron.kempf

listen dude.. the problem with Excel is that you DO have 10 formulas
per calculation.

it is much more efficient to have these as set based operations--
instead of having hundreds and hundreds of lines of unnneeded formulas.

excel is just a PITA

you RECREATE THE SAME REPORT BY HAND EVERY DAY WHAT THE FLYING **** IS
WRONG WITH YOU PEOPLE?
 
H

Harlan Grove

(e-mail address removed) wrote...
listen dude.. the problem with Excel is that you DO have 10 formulas
per calculation.

I didn't mention formulas per calculation. Sometimes that's the case,
but there are some types of analysis that require a lot of calculations
to return a given result. Linear regression is one such type. One
formula on N+K entries necessarily performs O(N^3+K) underlying
calculations.
it is much more efficient to have these as set based operations--
instead of having hundreds and hundreds of lines of unnneeded formulas.

If set operations would work. You don't get it about order-dependent
and recursive algorithms. There are things set based operations can't
do without a LOT of contortions. Generally, it's easier to make
procedural and functional languages provide set based operations than
to make set oriented languages like SQL provide order-dependent and
recursive referencing.

If you don't believe me, go on and write a permutation generator in SQL.
 
A

aaron.kempf

yes, i do believe that any function that you REALLLLLLLLLLLLLY need can
be easily recreated by UDFs. If they can't that is where you can have
a programmer in to help you with your 'super-duper hard math'--

god you are just a flaming idiot.. and AOL user.. and an Excel FAG

you CAN have security and unrestricted access.

you can have security in one place and unrestricted access in others.

where you build SPROCS and VIEWS-- you can have whatever perms you
want.

It's just much better than KEEPING YOUR SHORTS AROUND YOUR ANKLES AND
LETTING PEOPLE 'FUDGE NUMBERS' WHENEVER THEY WANT.

That's the problem with Excel-- it is too easy to use
incorrect/WRONG/outdated data.

having a hundred copies of the same data-- all sorted in different
directions.. GIVE ME A BREAK~!~!~!

These functions are all easily and freely available on the internet--
if you really MUST have this 'complex math'-- gag me with a spoon.

The point of the matter is that SQL Server is EXTENSIBLE. Where as
Excel is just a dead-end street.

Excel is a TOTAL waste of time.. and you guys aren't worth JACK SHIT in
the marketplace.

I just hope that some day; your cornholer managers will realize what a
waste of time you guys have been.. i know it's coming soon

i just think that it's fucking hilarious.. that you guys sit there; you
insulate yourself from the reality that is todays' marketplace.. you
guys sit there and think 'oh, as long as im REALLY GOOD WITH EXCEL than
i'll always have work'

LOL

LOLOLOLOLOLOLOLOL

WHAT ARE YOU GOING TO DO WHEN YOU HIT 64K ROWS, HARLAN?

WHAT IS YOUR RECCOMENDATION FOR THE OP?

USE EXCEL AND ONLY LOOK AT THE FIRST 64k ROWS?

HAHAHAHAHAHAHAHA

WHAT ARE YOU GOING TO DO WHEN YOU HAVE THIS STUPID EXCEL REPORT WITH
40K ROWS AND YOUR COMPANY _GROWS_ AND NOW YOU NEED 70K ROWS?

I mean seriously-- what is your resolution, mr smarty pants?

my resoultion is to build SCALABLE APPS that have BETTER REPORTING than
that piece of crap, unmanageable SPREADSHEET DISEASE.

I really do want to know 'what math do you do that is so hard that i
cant do it in a database'-- do you still think that all the ATMs of the
world use EXCEL?

Do you really think that your way is the right way for small
businesses?
Do you really think that your way is the right way for medium
businesses?
Do you really think that your way is the right way for large
businesses?

I give you a resounding, NO, NO AND NO.

Small businesses shouldn't need to keep a spreadsheet dork around to
get their job done.

Medium businesses shouldn't need to keep 100 spreadsheet dorks to get
their job done.

LARGE BUSINESSES SURE AS **** DONT NEED 64,000 SPREADSHEET DORKS.

I never said that ALL USERS should be able to edit ALL DATA.

I'm saying that having a hundred different data islands is a WASTE OF
TIME.
you can have a solution that scales; that works reliably.. you dont
need to run out and buy sharepoint-- which is what you really need to
do if you have a hundred spreadsheets.

I'm not saying that these worthless 'statpack' functions are worthless.
I'm just saying that 90% of the people out there dont need to use them
on a daily basis. And for the last 10% of you power users (as if a
single spreadsheet dork has ever been POWERFUL) then you can run out
and find the functions with google and put them on ADP/MSDE

SQL Server has taken over the fucking world.

The best pivotTables in the world-- have nothing to do with EXCEL.

and I dont have limits at 64k rows.

Do you remember that i said that i had a client that hit the 2gb limit
in EXCEL?

THAT IS FUCKING COMICAL-- STICK 100 MONKEYS IN FRONT OF TYPEWRITERS FOR
100 YEARS AND DO YOU GET THE WORKS OF SHAKESPEARE?

no-- you get a bunch of worthless excel dorks


-aaron
 
H

Harlan Grove

(e-mail address removed) wrote...
yes, i do believe that any function that you REALLLLLLLLLLLLLY need can
be easily recreated by UDFs. If they can't that is where you can have
a programmer in to help you with your 'super-duper hard math'--

And it'd be completely pointless. I already have software that works.
It's called Excel. Other than in your delusions, why would it make
sense to reinvent the wheel?

Oh, that's right, in order to make Access do things Excel does better.

Clueless, clueless, clueless!
god you are just a flaming idiot.. and AOL user.. and an Excel FAG

Nothing like a good ad homenim attack when you can't make a reasoned
argument.
you CAN have security and unrestricted access.

you can have security in one place and unrestricted access in others.

Each user creates all the tables they want and all other users have
read-only access to it? Or all users can specify all the table layouts
they want, and all users can have read-write but not redesign access to
it? Who gets to specify any relations between John's XYZ table and
Jane's ABC view? Both John and Jane? What's to prevent either from
creating problems with other relations? For that matter, who gets to
decide what records could be deleted, or do you believe in infinite
disk storage? If specific individuals have more rights to some tables
than others, how do you manage succession, e.g., when John quits, who
assumes his rights to his tables? And that does even get to the BIG
RISKS when giving CREATE TABLE rights to naive users - other than
system crashes, what's to prevent them from inadertently creating
unindexed multiple terabyte flat files then running queries against
them?
where you build SPROCS and VIEWS-- you can have whatever perms you
want.

It's just much better than KEEPING YOUR SHORTS AROUND YOUR ANKLES AND
LETTING PEOPLE 'FUDGE NUMBERS' WHENEVER THEY WANT.

People can fudge numbers in databases. Unless absolutely *ALL* queries
are stored and *ALL* temporary tables are crossreferenced against the
stored queries, it soon becomes impossible to verify anything in
databases.

If it were so easy just to give all users basically unrestricted access
to database 'workspaces', don't you think it would have become a wider
spread practice than it is?
These functions are all easily and freely available on the internet--
if you really MUST have this 'complex math'-- gag me with a spoon.

They're not usually available in a form that could be dropped into a
VBA module and used without modification. There's a lot of cookbook C,
Java, Perl and Python code on the internet but not as much VB[A]. Just
try to find linear regression functions in VB[A] that handle
colinearity well. Or regular expression engines.
The point of the matter is that SQL Server is EXTENSIBLE. Where as
Excel is just a dead-end street.

If by extensible you mean able to employ add-on software modules, guess
what? Excel is also extensible. More easily so since Excel .XLA add-ins
can be developed in Excel itself. No doubt you'd have no idea how to do
this, but that doesn't mean it isn't possible.

If you mean multiple machines can be used to complete a single logical
task, that's nice. Excel isn't intended to be extensible in that way.
Making a software development platform extensible in that way
necessarily involves imposing some rigidity to provide the interfaces
needed to accomplish such extensibility. Excel is intended to be
flexible. That flexibility prevents scaling, but it allows other
functionality that would be difficult to impossible using centralized
databases (such as providing hundreds of mortgage brokers amortization
table templates they could use on disconnected laptops). You don't
understand that there are times when it's a GOOD THING to have
thousands of copies of more or less the same thing.
Excel is a TOTAL waste of time.. and you guys aren't worth JACK SHIT in
the marketplace.

Gosh, you'd have thought someone like our managers would have realized
that by now.

You won't understand this, but most of the rest of use are paid for
specific knowledge or abilities that aren't directly related to any
piece of software. Lawyers, accountants, financial analysts,
statisticians, market analysts aren't hire or paid for whether they
know Excel or Access or SQL server, they're hired and paid for what
they know about law, accounting, etc. They use software as tools to to
their jobs, but the software isn't the central focus of their jobs.
You, on the other hand, presumably work exclusively with software, and
the central focus of your job is the software. That skews your
perspective.

There'll always be very highly paid professionals who know squat about
databases, and they'll hire people who hire people who hire people who
hire grunts like you to clean out the IT sewer pipes.
i just think that it's fucking hilarious.. that you guys sit there; you
insulate yourself from the reality that is todays' marketplace.. you
guys sit there and think 'oh, as long as im REALLY GOOD WITH EXCEL than

Since few of us are hired specifically to program in Excel or anything
else but are hired for our subject knowledge, I think we're pretty
safe.

If we were like you and were just churning out reports, we might need
to worry about whether we're up to date on databases. Mercifully, few
of us are like you.
i'll always have work'

Just like septic tank cleaners and practical nurses to empty bedpans.
WHAT IS YOUR RECCOMENDATION FOR THE OP?

Oh, now we're back to the original topic, are we?

Reread the OP's follow up, from which: "Let's assume that we must use
EXCEL[...]" Gee, what a radical concept in an Excel newsgroup!

To be honest, I had nothing to add to Bob Phillips's responses. The
OP's tasks is likely to be better suited to databases. My responses to
you were due to your overly broad assertions about what Access can do.
So far you've failed to show that Access or MSDE or SQL Server or
Analytical Services can do several things I've shown can be done
without much fuss or bother in Excel. Sifting out the bluster in your
responses, it's impossible to tell whether you can handle even any
database task more complicated than calculating a check register.
WHAT ARE YOU GOING TO DO WHEN YOU HAVE THIS STUPID EXCEL REPORT WITH
40K ROWS AND YOUR COMPANY _GROWS_ AND NOW YOU NEED 70K ROWS?

No one reads reports with 40K rows. At 60 lines per page, 40K rows
means over 666 pages (the number of the beast report). Some mainframe
reports generate +1,000 page printouts, but they're generally used like
phone books or dictionaries. Things like that are best left on
centralized machines. But when it comes to distilling those reports,
it's open question what the best tool would be. Often, but not always,
it'd be a database *IF* the source data could be accessed via queries.
I mean seriously-- what is your resolution, mr smarty pants?

Use a database if you need a database. However, databases aren't useful
for every tasks that benefit from computer processing.
my resoultion is to build SCALABLE APPS that have BETTER REPORTING than
that piece of crap, unmanageable SPREADSHEET DISEASE.

Fine if you're generating reports based on data from central data
stores.
I really do want to know 'what math do you do that is so hard that i
cant do it in a database'-- do you still think that all the ATMs of the
world use EXCEL?

ATM math is SIMPLE, much like your thought processes are simplistic.
All ATMs do is add and subtract. Not all that difficult.

Do you believe all math is that simple?
Do you really think that your way is the right way for small businesses?

For bookkeeping? I wouldn't recommend Excel, but I wouldn't recommend
Access either. Quicken Books would make more sense to me. And just out
of curiousity, is there tax prep software that interfaces with Access?

For customer management or inventory control, Access may be useful, but
it'd be a better idea to buy prepackaged single purpose software in
order to avoid wasting time programming rather than selling to or
servicing existing customers and extending the customer base.
Do you really think that your way is the right way for medium businesses?

For repeating tasks that use existing data, databases would be the best
tools to use.

On the other hand, if you mean generating quotes for long-term
projects, I'd pull some data from databases, but I'd build the quote in
Excel in order to perform what-if analysis to identify the key risks.
Do you really think that your way is the right way for large businesses?

Same reply as for medium businesses. For repetitive, easily automated
tasks, use databases. For more customized analysis to be performed by
professionals, give them the tools *THEY* ask to use. If they ask for
Excel, give 'em Excel. If they ask for Access, give 'em Access. If they
ask for MatLab, give 'em MatLab. But don't screw around giving everyone
Access and tell them to write their own udfs for everything Access
doesn't provide.
I give you a resounding, NO, NO AND NO.

Since I never said to use Excel for everything, this is a red herring.

I said use the best tool for the task. Access/MSDE/SQL Server isn't the
best tool for every task.
Small businesses shouldn't need to keep a spreadsheet dork around to
get their job done.
....

And if the single proprietor is the spreadsheet user, s/he should fire
him/herself?
I never said that ALL USERS should be able to edit ALL DATA.

Why can't I put words into your mouth like you put them in mine?
I'm saying that having a hundred different data islands is a WASTE OF
TIME.

If everyone needs that data, true. Not all data is needed by all users.
All needed data isn't always already available from centralized
databases.
you can have a solution that scales; that works reliably.. you dont
need to run out and buy sharepoint-- which is what you really need to
do if you have a hundred spreadsheets.

Who uses Sharepoint?
I'm not saying that these worthless 'statpack' functions are worthless.
I'm just saying that 90% of the people out there dont need to use them
on a daily basis. And for the last 10% of you power users (as if a
single spreadsheet dork has ever been POWERFUL) then you can run out
and find the functions with google and put them on ADP/MSDE

Clueless.

Why should I want to reinvent the wheel? Most of the free or open
source functions exist wrapped in interfaces specific to other systems
and aren't written in VB. There are commercial libraries, but they
require interface functions. And why should I want to pay for
functionality I already have?

As for '90% of users . . .', most users don't try to misuse
spreadsheets as databases. And only a small fraction of spreadsheet
users generate any reports at all, whether in Excel or Access or
anything else.
SQL Server has taken over the fucking world.

Odd, you'd think Oracle and IBM would be baknrupt if this were true.
 
A

aaron.kempf

hahahah yeah how funny.. you bitch about having to recreate the wheel
WHEN YOU MAKE THE EXACT SAME SPREADSHEET 3 TIMES PER WEEK WITH
DIFFERENT DATA

copy and paste isn't an efficient way to run a business

all im saying is that you LAWYERS and 'ANALYSTS (GAG)' could be more
efficient if you built a reliable, scalable solution from the ground
up.

you sit there and RECREATE THE SAME FUCKING REPORT EVERY WEEK

and what you dont fucking realize you chickenshit.. im not talking
about MDB.. im not talking about UDFs written in MDB or VBA or any
other piece of shit language

im talking about MSDE/SQL Server-- im talking about letting you guys
actually DO SOMETHING instead of spinning your wheels recreating the
same spreadsheet 3 times per week

every software in the world can interface with Access.. it's called
ODBC.. and it friggin ROCKS. Excel is just a poor repository for data.

It's not all about off the shelf products. Those never work like you
need them to.

I'm talking about open systems that are SCALABLE

what i still dont understand.. mr Harlan KNOW IT ALL
is WHAT IS THE OP SUPPOSED TO DO TO GET AROUND THE 64K LIMIT?

what am i supposed to do when i have a spreadsheet with 20k records--
can i really rely on keeping this under 64k records?

I just know of a BILLION ways that are more efficient to do this than
to hang out with crippled software all day long.
Excel is all about having a hundred copies of the same formula-- it is
friggin ridiculous way to run your business.

with RDBMS you have triggers-- you have centralized reports (views and
sprocs)
you have EXTENSIBLE SOLUTIONS that can import and export from a BILLION
different data sources.

With Excel; you have a billion data islands that make your life more
comples.

it's the difference between using a bicycle vs a 4x4. Databases can go
ANYWHERE and bicycles CAN'T GO ANYWHERE FAST ENOUGH

I believe that the ONLY way for corporate america to BE COMPETITIVE is
to throw excel out the fucking window; along with all you excel dorks
that have the AUDACITY to sit around and recreate the same spreadsheet
3 times a week.

Can you actually sleep at night; thinking about how you WASTE MONEY for
your company?

Can you sleep at night; just throwing away money like that?

I can automate you out of a job in an HOUR
and i know for a fact that you guys automate your own workweek if you
would just learn to use a real tool for making reports.

Excel is a total waste of time; the formulas aren't powerful enough--
it is a dead end street.. and it's basically impossible to automate.

A HUNDRED BILLION PAGES OF EXCEL VBA CANT BE WRONG CAN IT?

actually.. yes-- it can be wrong. go ahead and record your macros--
rely on a house of cards if you want.

i just know from first hand experience.. that there are TOO MANY
INDIANS AND NOT ENOUGH CHIEFS. Too many soldiers and not enough tanks.

Learn to move data around on a schedule.. WITHOUT WRITING A SINGLE LINE
OF CODE

god forbid you actually PROGRAM gasp.. oh, im NOT A PROGRAMMER.. im
just a worthless EXCEL DORK. I copy and paste data around with one
hand so i can sit there and jerk off and think about how cool i am

YOUR MATH IS NOT TOO COMPLEX FOR DATABASES JACKASS
 
H

Harlan Grove

(e-mail address removed) wrote...
hahahah yeah how funny.. you bitch about having to recreate the wheel
WHEN YOU MAKE THE EXACT SAME SPREADSHEET 3 TIMES PER WEEK WITH
DIFFERENT DATA
....

How little you know (or are capable of learning). Are all of your
tables completely normalized? No duplicate entries anywhere? Do you
know the relative cost of eliminating *ALL* duplication vs allowing a
little bit of duplication?

If you mean I use workbooks based on the same template (all the labels
and formulas but no data), in which other people have entered different
customers' data then saved multiple different workbooks with different
customer's data in each, then you're right. But, since you seem
incapable of understanding this, that's analagous to running the same
parametrized query with different parameter values. The workbooks
*SHOULD* *BE* exactly the same except for the entered data AND the
formula results.
all im saying is that you LAWYERS and 'ANALYSTS (GAG)' could be more
efficient if you built a reliable, scalable solution from the ground
up.
....

How? (Rhetorical question, the answer is obviously 'No') Do you have
any idea how securities lawyers create the filings necessary for equity
or debt offerings? Do you believe every single client of theirs fits
into a single cookie-cutter model? Same for financial analysts.

Different clients have different characteristics. Maybe a single,
highly parametrized approach could be developed, costing $ millions,
but lawyers are smarter than you. They don't waste either their time or
money on pointless generalization when tools exist to create what they
need in hours rather than months. Even if they have to recreate the
hours of work for each customer, that's still cheaper than building
general systems.
im talking about MSDE/SQL Server-- im talking about letting you guys
actually DO SOMETHING instead of spinning your wheels recreating the
same spreadsheet 3 times per week
....

To repeat yet again, for anyone who works for a company that doesn't
use SQL Server and gives most of their employees Office Standard rather
than Office Professional, your ranting is completely irrelevant. Those
people won't have SQL Server and they won't have Access. Some other
people may have Access but not SQL Server, and unless their IT
departments either installed MSDE for them or give them Office CDs
(both are extremely unlikely), those other people can't do squat with
MSDE or SQL Server.

You've deluded yourself into thinking that most business PC users have
access to these software packages. WRONG!
every software in the world can interface with Access.. it's called
ODBC.. and it friggin ROCKS. Excel is just a poor repository for data.

Yes, but without MSDE or SQL Server, Access only provides MDB
databases, no? And what have you said about MDB databases? When are you
gonna pull your head out?
It's not all about off the shelf products. Those never work like you
need them to.
....

Maybe not exactly like you need them to, but close enough that they're
ready to use AT MUCH LOWER COST than screwing around reinventing their
functionality in an rdbms.
what i still dont understand.. mr Harlan KNOW IT ALL
is WHAT IS THE OP SUPPOSED TO DO TO GET AROUND THE 64K LIMIT?
....

As I've said before, use a database. For anyone who need to manage
thousands or records of data, spreadsheets aren't the best tool to use.
However, you're the one claiming databases can do EVERYTHING
spreadsheets can and more efficiently. There you're dead wrong. Large
amounts of data with a few simple calculations (such as the ATMs you
keep bringing up), databases are best. Small amounts of data with lots
or complex calculations, spreadsheets are much better than databases
(though there may be even better software to use, but few people would
have such alternatives or know how to use them). Large amounts of data
and lots of complex calculations, mainframes running SAS or SPSS would
probably be best, and comparable stats packages on PC if no access to
mainframes.
it's the difference between using a bicycle vs a 4x4. Databases can go
ANYWHERE and bicycles CAN'T GO ANYWHERE FAST ENOUGH
....

Nice analogy. I suppose that makes Oracle the analog to freight trains
and DB/2 supertankers and container ships.

If you need to travel long distances carrying lots of stuff (and you
don't need to maneuver much), you have access to more power. On the
other hand, if you don't have much to carry and you want to move
between the trees in a thick forest or travel through narrow streets
with lots of pedestrians, the bike would be the better vehicle. Not
everyone needs to carry tons of data to go where they want to go.
I can automate you out of a job in an HOUR

Go on. Spend and hour and then show us all how a permutation generator
can be implemented in an rdbms.

Pure BS! You know nothing except a little bit about a handful of
different databases. You seem to think that's more important than
knowing how to sell product or manage people. If you could ever pull
your head out of your backside, the fresh air might be enough to allow
your brain to begin functioning.
Excel is a total waste of time; the formulas aren't powerful enough--
it is a dead end street.. and it's basically impossible to automate.

No, it's only impossible for *YOU* to automate because you're incapable
of learning how to use it efficiently.
A HUNDRED BILLION PAGES OF EXCEL VBA CANT BE WRONG CAN IT?

actually.. yes-- it can be wrong. go ahead and record your macros--
rely on a house of cards if you want.
....

And no one has ever made any mistakes using databases. ??!
i just know from first hand experience.. that there are TOO MANY
INDIANS AND NOT ENOUGH CHIEFS. Too many soldiers and not enough tanks.

You don't understand your place in the grand scheme of things. Those of
use with jobs that involve daily customer interaction, we're maybe the
infantry. Your kind are rear area latrine diggers, not tank crew.
Still, your kind performs necessary and useful tasks, but the average
infantry soldier would prefer a collapsible shovel that he can carry
along with weapon, ammunition and rations to trying to carry a backhoe
on his back, and driving around in a backhow makes one more of a target
than a soldier.
Learn to move data around on a schedule.. WITHOUT WRITING A SINGLE LINE
OF CODE
....

And how does one do that if most of the data one needs comes from
customers via e-mail?
YOUR MATH IS NOT TOO COMPLEX FOR DATABASES JACKASS

If only you could PROVE that. All you seem to be able to do is just SAY
databases can do things I've already provided detailed instructions for
doing in Excel. Those instructions are brief because the tasks are so
simple to do in Excel. If they're so simple to do in Excel, wouldn't
they be even simpler to do in databases? That so, EVEN YOU could figure
out how to do them them post the instructions here in order to show me
how stupid I am.

I won't hold my breath waiting for you to thoroughly humiliate me. But
feel free to try.
 
A

aaron.kempf

yeah. so go and use a database, OP.

and everyone else-- when you have 20k records; you better start looking
at using a database since excel has NO WAY for getting around this 64k
limit.

it's like.. do you really want to rewrite your apps from the ground up
whenever you get a couple of extra records?

Are you really saying that this is more efficient?

And do you honestly think that i give a flying shit that db2 and oracle
will run on linux and a dozen other OS?

the point of the matter is CHOOSING THE RIGHT SOLUTION FOR YOUR
ENVIRONMENT. And since all you idiots use is excel-- and you're doing
this on Windows--- it makes perfect sense to use locally installed MSDE
on your desktop.

I'm not talking about running out and getting hundreds of new unix
servers.
I'm talking about using a FREE--- FUCKING FREE--- database engine that
_IS_ sql server.

and i can do all your permutations whenever you want. It's called a
cartesian-- and there is no realistic way to do this in excel.. you
HAVE TO use a database to cartesian data.

I dont agree with your 'small amounts of data with lots of calculations
is better in excel'

For starters
a) you can't always forecast how many records you're going to have
tomorrow, next week, next month, next year.
b) Excel ISNT any better than a database for simple math like you
simpletons claim is 'too complex for a db'
c) Excel ISNT any EASIER than a database for simple reports. I can run
circles around you, you idiot.

normalization isn't possible in excel.. denormalization in excel makes
things IMPOSSIBLE.
and you can't even enforce referential integrity.

i mean-- you're not even on the drawing board.. you can't do math.. you
can't AUTOMATE your job.
and you deserve to be on the street.. drinking out of a bottle..
becuase of the FACT that you haven't adapted to the needs of your job.

Go and play with your spreadsheets buddy.. And go ahead and recreate
things whenever you hit 20k records. For all i care.

The point of the matter is that ANY DATA THAT YOU HAVE SHOULD BE STORED
IN A DATABASE
spreadsheets are TOTALLY overused throughout the world. any time that
you are making the same report week in and week out.. you should be
using a database.

Excel just ISN'T FUNCTIONAL enough to do jack shit.

MSDE and SQL Server have taken over the world.

Having a local installation of MSDE on power users' desktop poses no
more of a risk than having a MDB on someones desktop.

I'm sorry that you work for a bunch of UNIX FAGS.

Go play with your AOL address, you idiot.

YES.. I DO CLAIM THE EVERYTHING THAT YOU DO FITS INTO A NICE LITTLE
COOKIE CUTTER. OR MAYBE A HUNDRED DIFFERENT COOKIE CUTTERS.

YOU SIT THERE AND BUILD THE SAME FUCKING REPORT IN EXCEL WEEK IN AND
WEEK OUT
Your inability to adapt to technology means that you should be drinking
wine out of a paper bag on the side of the street.

You are replaceable. Your skillset is 20 years out of data.
You would be better off with pen and paper.
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Top