Hi,

Does anyone has experience or information on the performance and maximum number of records using the Data Extension?

Thanks.

Rgds,
Andrew Ang

Hi Frédéric,

Nice to hear from you. I understand the retrieval of data from the Sharepoint list is done using a webservice. Is there any technical limit on the maximum number of items in the list that can be retrieved? Subject to the timeout of the IIS?

Nope. There is no performance problem at the moment.

Thanks.

Rgds,
Andrew Ang

Hi Andrew,

Following your question, we have gone into some tests with a list containing 25000 items.


We did not have to change any timeout configuration settings to get the report running.
We have monitored report execution times and obtained the following results :


It would have been possible to further optimize the  Data Retrieval time by only retrieving the necessary fields instead of all the list's fields as we did in our tests :


The tests have been run on 2 virtual machines hosting respectively SPS 2003 and SQL Reporting Services 2005. The 2 virtual machines were hosted on a PIV 3ghz desktop PC.

We were rather pleased with the results though it should also be tested in real world situations were other transactions are taking place.

We would like to know what you are thinking of the results? Do you have lists with more than 25000 items? Would you like us to make some other tests?
Regards,

---

Frederic LATOUR
ENESYS

Hi Andrew,
In the same time, I don't feel like 17 seconds (time is expressed in milliseconds)  is that much time to wait for a 575 pages report.

If you apply a filter using a CAML Query on the list (even when using report parameters), the filter will take place on the SharePoint Server and you will retrieve the data much faster.
As an example, I ran the same report for products which unit price is greater or equal to 100 (2028 rows are retrieved). In that case the report is displayed in less than 4 seconds.

Be aware that I realized the tests on virtual machines so that it might be possible to obtain better figures in an optimized environnement. Report Server also offers many options for optimizing large reports.

The report data comes from the Order Details table from the famous Northwind sample that has been duplicated several times in order to get a large list.
I have never tried this dish. I didn't even know it existed. I could get some information on the net since then. Maybe I can find a restaurant in Paris to try it out. I you have have a good "Singaporean" restaurant in Paris to suggest, I'll take it.

Regards,

---

Frederic LATOUR
ENESYS