arXiv Scraper: how to get New Papers by Query as JSON/CSV (API, Python, no code)
Pull newly-submitted arXiv preprints by query. This guide shows the output fields, a working input, and
Python, JavaScript and cURL code for the Actor v0iddo/arxiv-daily-papers on Apify.
What data you get
One row per result. Every row can be downloaded as JSON, CSV, Excel or HTML, or read through the API.
| Field | Label | Type | Example |
|---|---|---|---|
arxivId | Arxiv Id | text | 2610.32971 |
version | Version | text | v1 |
title | Title | text | RobustRLlib: A Unified Library and Benchmark for Robust Reinforceme... |
authors | Authors | list | |
primaryCategory | Primary Category | text | cs.LG |
categories | Categories | list | |
published | Published | date | 2026-10-23T17:57:22Z |
updated | Updated | date | 2026-10-23T17:57:22Z |
doi | Doi | text | |
journalRef | Journal Ref | text | |
comment | Comment | text | Project page, code, and tutorial: https://robustrl-lib.github.io/ |
pdfUrl | Pdf Url | URL | https://arxiv.org/pdf/2610.32971v1 |
absUrl | text | https://arxiv.org/abs/2610.32971v1 | |
query | text | cat:cs.LG | |
abstract | text | Robust reinforcement learning (RL) is critical for reliable real-wo... |
Input example
This is the input that is pre-filled on the Actor page. Change the values for your own run.
{
"queries": [
"cat:cs.LG"
],
"maxResultsPerQuery": 20
}
| Input field | Type | What it does |
|---|---|---|
queries (required) | array | Search queries in arXiv API syntax, the same as the search box at arxiv.org. |
sinceDays | integer | Filter by submittedDate >= now-sinceDays. |
maxResultsPerQuery | integer | Hard cap per query. arXiv recommends max 2000 per call; we paginate up to this number. |
includeAbstract | boolean | Adds the summary/abstract text. |
Output sample
Real rows from a run of the Actor. Fields that name people are left out of the sample.
[
{
"arxivId": "2610.32971",
"version": "v1",
"title": "RobustRLlib: A Unified Library and Benchmark for Robust Reinforcement Learning Algorithms",
"primaryCategory": "cs.LG",
"published": "2026-10-23T17:57:22Z",
"updated": "2026-10-23T17:57:22Z",
"comment": "Project page, code, and tutorial: https://robustrl-lib.github.io/",
"pdfUrl": "https://arxiv.org/pdf/2610.32971v1",
"absUrl": "https://arxiv.org/abs/2610.32971v1",
"query": "cat:cs.LG",
"abstract": "Robust reinforcement learning (RL) is critical for reliable real-world deployment, where policies may fail under diverse shifts and disru..."
},
{
"arxivId": "2610.32969",
"version": "v1",
"title": "DexPort: A Hand-Held Skill Interface for Dexterous Hand Data Collection",
"primaryCategory": "cs.RO",
"published": "2026-10-23T17:56:28Z",
"updated": "2026-10-23T17:56:28Z",
"comment": "Website: https://amberxie88.github.io/dexport/",
"pdfUrl": "https://arxiv.org/pdf/2610.32969v1",
"absUrl": "https://arxiv.org/abs/2610.32969v1",
"query": "cat:cs.LG",
"abstract": "Collecting high-quality demonstrations remains a central bottleneck for learning dexterous manipulation. Teleoperation records executable..."
}
]
Code: Python, JavaScript and cURL
Get your API token in Apify Console under Settings, then Integrations. The Actor id is v0iddo/arxiv-daily-papers.
Python (apify-client)
from apify_client import ApifyClient
client = ApifyClient("YOUR_APIFY_TOKEN")
run_input = {'queries': ['cat:cs.LG'], 'maxResultsPerQuery': 20}
run = client.actor("v0iddo/arxiv-daily-papers").call(run_input=run_input)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)
JavaScript (apify-client)
import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });
const input = {
"queries": [
"cat:cs.LG"
],
"maxResultsPerQuery": 20
};
const run = await client.actor('v0iddo/arxiv-daily-papers').call(input);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);
cURL
curl -X POST "https://api.apify.com/v2/acts/v0iddo~arxiv-daily-papers/run-sync-get-dataset-items" \
-H "Authorization: Bearer YOUR_APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{"queries": ["cat:cs.LG"], "maxResultsPerQuery": 20}'
Price
$1.00 per 1,000 results. You pay per result row. There is no separate charge per run. Higher Apify plans pay less per result, down to $0.70 per 1,000. See the pricing tab for your plan. A new Apify account gets $5 of platform credit every month.
FAQ
What data does the arXiv Scraper return?
Each result is one row in an Apify dataset. Fields include arxivId, version, title, authors, primaryCategory, categories, published, updated, and more. The table above shows every field with an example value.
How do I use the arXiv Scraper from Python?
Install the apify-client package, create a client with your Apify API token, call the Actor v0iddo/arxiv-daily-papers with an input like the one above, and read the rows from the run's dataset. The Python snippet above does exactly that.
Can I use it without writing code?
Yes. Open the Actor page on Apify, fill in the input form (an example is already filled in), press Start, and download the results as JSON, CSV, Excel or HTML. You can also schedule runs there.
How much does it cost?
$1.00 per 1,000 results. You pay per result row. There is no separate charge per run. Higher Apify plans pay less per result, down to $0.70 per 1,000. A new Apify account gets $5 of platform credit every month.
How do I limit the number of results?
Set a maximum cost for a run in the run options on Apify, and the run stops when it is reached.
Can I send the results to Google Sheets, Make, Zapier or n8n?
Yes. Apify datasets connect to Google Sheets, Slack, Make, Zapier and n8n, and a webhook can call your own service when a run finishes. You can also export the dataset as JSON, CSV or Excel.
Related guides
- News article scraper: Extract news articles from any publisher.
- Hacker News Scraper: Search Hacker News via the public Algolia API.
- ClinicalTrials.gov Scraper: Pull recently-updated ClinicalTrials.gov studies matching a query.