This topic is locked

export to excel or csv limit?

11/22/2006 6:35:21 AM
ASPRunnerPro General questions
M
maurello author

Hi,
my users try to extract quite big data sets (about 20-30.000 records), but unfortunately IIS always kind of times out and a error 500 is displayed. I monitored the CPU usage during the extraction and it is indeed very high.
Is there a limitation? How can I solve this problem?

Sergey Kornilov admin 11/22/2006

Mauro,
if you getting a timeout error you can increase timeout either in IIS settings or in the script itself.

<% Server.ScriptTimeout = 3600 %>
M
maurello author 11/23/2006

Hi Sergey,
I tried to increase the ASP script timeout in IIS and also the ScriptTimeOut in the #_export.asp file to 600 seconds, but I still get an internal server error (500). IE starts to load after I click on "export", and after some minutes I get the error.
I monitored the server after I clicked on export and indeed the extract is heavy. I have 2 HT Xeon CPU and 2-3 threads are 50-60% busy (IIS process) while IE loads the extract. Then suddenly IE shows the error 500 and the CPU load goes down to 0%.
I am wondering if the problem is the 32-bit emulated mode of IIS, while SQL Server runs in native 64-bit. It looks to me that IIS has problems to assemble the extract before sending it to the client.

Sergey Kornilov admin 11/23/2006

Mauro,
I hope connection string change will fix this one as well. See the other thread related to 64-bit mode.

M
maurello author 11/27/2006

I solved the 64-bit problem and now my application runs natively in a 64-bit IIS environment. However, I still have the problem to export to Excel or other formats.
It takes a lot of resources and an unusual amount of time to extract the data from my database. I think the problem is with IIS, because that's the process that eats up all the resources of my server when I run the extract. On the other hand, SQL Server 2005 process is idle, which means that the query retrieves data basically immediatly from the database server, but then it takes time for the webserver to assemble the file. Am I correct? And how can I solve this problem?

Alberto 11/28/2006

Hi, I have exactly the same problem. I tried all solutions sugested before by sergey but I can't get the records. It would be good if we can use asprunner to export bigger amount of records.

Thanks a lot.

Sergey Kornilov admin 11/29/2006

There might be some natural limit of what amount of data ASP is able to process however I don't think this is the case. Error 500 actually means sme error happened.
Mauro and Alberto,

contact me directly. To reproduce this issue I need either access to your server or both generated application and data set.