Version 3.1 will introduce a new paging mechanism for better handling lists containing a large number of items.
In current version of Enesys RS Data Extension, items from a given SharePoint list are retrieved all at once when using a list statement. This is usually not a problem with most SharePoint lists. However, with large lists, the SharePoint Web Service that is called to retrieve list's items may throw an "out of memory" exception. The exact limit you will be facing depends on several parameters such as your server configuration, the number of columns you are retrieving, the type of data,...
In version 3.1, a new mechanism has been implemented for retrieving list's data in chunks of 4 000 items. This number is configurable by setting the new "paging" attribute to the desired value as shown in the following query:
This new approach will make it possible to deal with lists containing more than 80 000 items.
Even if you do not encounter any "out of memory" errors, you may be interested in using this feature for putting less pressure on you SharePoint server.