---
title: "Efficient large dataset retrieval with field selection"
description: "Optimize large dataset retrieval using field selection, pagination, and filtering"
source: https://apitube.io/cookbook/efficient-large-dataset-retrieval-with-field-selection
---

#### Input parameters

| Parameter        | Description                                    | Type    | Default | Required |
|:-----------------|:-----------------------------------------------|:--------|:--------|:---------|
| category.id      | Category filter.                               | string  |         | Yes      |
| published_at.start | Start date filter.                             | string  |         | Yes      |
| published_at.end | End date filter.                               | string  |         | Yes      |
| per_page         | Articles per page (100 for large datasets).    | integer | 100     | Yes      |
| page             | Page number for pagination.                    | integer | 1       | Yes      |
| sort.by          | Sort by publication date.                       | string  |         | Yes      |
| sort.order       | Descending order.                               | string  |         | Yes      |
| fl               | Field selection for optimization.               | string  |         | Yes      |
| api_key          | Your API key.                                  | string  |         | Yes      |

#### Workflow examples

##### Request for efficient large dataset retrieval:

```shell
curl -X GET "https://api.apitube.io/v1/news/everything?category.id=medtop:13000000&published_at.start=2023-01-01&published_at.end=2023-12-31&per_page=100&page=1&sort.by=published_at&sort.order=desc&api_key=YOUR_API_KEY"
```

##### Request for performance optimization for large datasets:

```shell
curl -X GET "https://api.apitube.io/v1/news/everything?fl=id,title,source.domain&per_page=100&published_at.start=2024-01-01&api_key=YOUR_API_KEY"
```

##### Request for paginated multi-criteria search:

```shell
curl -X GET "https://api.apitube.io/v1/news/everything?organization.name=Amazon&sentiment.overall.polarity=positive&per_page=25&page=3&sort.by=published_at&sort.order=desc&api_key=YOUR_API_KEY"
```

---

#### Related Examples

- [Select specific fields](/cookbook/select-specific-fields-to-reduce-payload-size)
- [Comprehensive analytics dashboard](/cookbook/comprehensive-analytics-dashboard-query)
- [Sort by engagement score](/cookbook/sort-articles-by-engagement-score)
- [Get sorted news by date](/cookbook/get-sorted-news)
- [Export articles to Excel](/cookbook/export-articles-to-excel-format)