downloading a big dataset daily?

M

marulo

Hi, I am new to this forum and have a question that might be too simple or
easy for you guys. I'll try to do my best describing my problem and what I am
doing so far to solve it...

I want to download a daily database from a website. I set up a program that
tells the computer to go everyday and opens an excel file that has a web
query embbeded to it. The query goes to the website and selects the table I
need and downloads it. Then, the program saves it with a csv format and
name=date.
So far so good....The problem is that the website now provides a table with
more than 65536 observations [maximum allowed by my MS Excel 2002 SP1].
Therefore, I am missing a part of the dataset I need...

1) I was thinking about migrating to access and use the same query. I never
used access and from the quick search I did, it doesn't seem like the same
query can be used.

2) What if I set the web query in excel to split the dataset in pieces of
60K or less lines and place them in different parts of the file?

Any suggestion?

Thanks in advance
 
M

marulo

I guess it is too obvious I am new to the group....
thanks a lot DL
M

DL said:
Perhaps try posting to an MS.public.access or excel ng?

marulo said:
Hi, I am new to this forum and have a question that might be too simple or
easy for you guys. I'll try to do my best describing my problem and what I am
doing so far to solve it...

I want to download a daily database from a website. I set up a program that
tells the computer to go everyday and opens an excel file that has a web
query embbeded to it. The query goes to the website and selects the table I
need and downloads it. Then, the program saves it with a csv format and
name=date.
So far so good....The problem is that the website now provides a table with
more than 65536 observations [maximum allowed by my MS Excel 2002 SP1].
Therefore, I am missing a part of the dataset I need...

1) I was thinking about migrating to access and use the same query. I never
used access and from the quick search I did, it doesn't seem like the same
query can be used.

2) What if I set the web query in excel to split the dataset in pieces of
60K or less lines and place them in different parts of the file?

Any suggestion?

Thanks in advance
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Top