vøiddo guidesAll Actors on Apify

Medium Scraper: how to get Articles by User, Tag or Publication as JSON/CSV (API, Python, no code)

Pull Medium articles via the public RSS feed endpoints: /feed/@user, /feed/tag/{tag}, /feed/{publication-slug}. This guide shows the output fields, a working input, and Python, JavaScript and cURL code for the Actor v0iddo/medium-rss-tracker on Apify.

Open Medium Scraper on Apify

What data you get

One row per result. Every row can be downloaded as JSON, CSV, Excel or HTML, or read through the API.

FieldLabelTypeExample
idIdURLhttps://medium.com/p/62edea66ffa4
titleTitletextUpdating Our Rules - June 2023
linkLinkURLhttps://medium.com/blog/updating-our-rules-june-2023-62edea66ffa4?s...
authorAuthortext
pubDatePub DatetextWed, 28 Jun 2023 18:01:22 GMT
summarySummarytextThis month, we are updating our Rules. As the world evolves, so do ...
categoriesCategorieslist["rules", "medium"]

Input example

This is the input that is pre-filled on the Actor page. Change the values for your own run.

{
  "feeds": [
    "@medium",
    "tag/programming",
    "tag/data-science"
  ],
  "maxArticlesPerFeed": 20
}
Input fieldTypeWhat it does
feedsarrayMedium feed paths: '@username', 'tag/{topic}', or publication slug
maxArticlesPerFeedintegerCap articles per feed

Output sample

Real rows from a run of the Actor. Fields that name people are left out of the sample.

[
  {
    "id": "https://medium.com/p/62edea66ffa4",
    "title": "Updating Our Rules - June 2023",
    "link": "https://medium.com/blog/updating-our-rules-june-2023-62edea66ffa4?source=rss-504c7870fdb6------2",
    "pubDate": "Wed, 28 Jun 2023 18:01:22 GMT",
    "summary": "This month, we are updating our Rules. As the world evolves, so do the ways in which people use Medium. To accommodate this, we regularly...",
    "categories": [
      "rules",
      "medium"
    ]
  },
  {
    "id": "https://medium.com/p/cccf29534bf4",
    "title": "Email Import Terms of Use",
    "link": "https://policy.medium.com/email-import-terms-of-use-cccf29534bf4?source=rss-504c7870fdb6------2",
    "pubDate": "Mon, 08 Nov 2021 17:24:26 GMT",
    "summary": "Effective as of November 8th, 2021"
  }
]

Code: Python, JavaScript and cURL

Get your API token in Apify Console under Settings, then Integrations. The Actor id is v0iddo/medium-rss-tracker.

Python (apify-client)

from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_TOKEN")

run_input = {'feeds': ['@medium', 'tag/programming', 'tag/data-science'],
 'maxArticlesPerFeed': 20}

run = client.actor("v0iddo/medium-rss-tracker").call(run_input=run_input)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

JavaScript (apify-client)

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });

const input = {
  "feeds": [
    "@medium",
    "tag/programming",
    "tag/data-science"
  ],
  "maxArticlesPerFeed": 20
};

const run = await client.actor('v0iddo/medium-rss-tracker').call(input);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

cURL

curl -X POST "https://api.apify.com/v2/acts/v0iddo~medium-rss-tracker/run-sync-get-dataset-items" \
  -H "Authorization: Bearer YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"feeds": ["@medium", "tag/programming", "tag/data-science"], "maxArticlesPerFeed": 20}'

Price

$0.20 per 1,000 results. You pay per result row. There is no separate charge per run. Higher Apify plans pay less per result, down to $0.14 per 1,000. See the pricing tab for your plan. A new Apify account gets $5 of platform credit every month.

FAQ

What data does the Medium Scraper return?

Each result is one row in an Apify dataset. Fields include id, title, link, author, pubDate, summary, categories. The table above shows every field with an example value.

How do I use the Medium Scraper from Python?

Install the apify-client package, create a client with your Apify API token, call the Actor v0iddo/medium-rss-tracker with an input like the one above, and read the rows from the run's dataset. The Python snippet above does exactly that.

Can I use it without writing code?

Yes. Open the Actor page on Apify, fill in the input form (an example is already filled in), press Start, and download the results as JSON, CSV, Excel or HTML. You can also schedule runs there.

How much does it cost?

$0.20 per 1,000 results. You pay per result row. There is no separate charge per run. Higher Apify plans pay less per result, down to $0.14 per 1,000. A new Apify account gets $5 of platform credit every month.

How do I limit the number of results?

Set a maximum cost for a run in the run options on Apify, and the run stops when it is reached.

Can I send the results to Google Sheets, Make, Zapier or n8n?

Yes. Apify datasets connect to Google Sheets, Slack, Make, Zapier and n8n, and a webhook can call your own service when a run finishes. You can also export the dataset as JSON, CSV or Excel.

Open Medium Scraper on Apify

Related guides