Skip to main content

Scraping services

These API services allow you to search for, request, and ingest data that has been scraped by Classify. This endpoint also works with GET, with a URL parameter u or url. Additionally, in the POSTed JSON payload, either u or url is acceptable.

Check for URL​

curl -X "POST" "https://api.clsfy.me/v1/scraping/search" \
     -H 'X-API-Key: 1234' \
     -H 'Content-Type: application/json; charset=utf-8' \
     -d $'{
  "url": "https://www.thegamer.com/skyrim-every-daedric-prince-realm/"
}'

Return codes​

  • 404 Not Found if the URL is not found
  • 422 Unprocessable Content if the URL is invalid
  • 202 Accepted if the URL is valid, but not yet craped

Successful response​

{
  "artifact": {
    "property": "www.thegamer.com",
    "type": "web page",
    "artifactType": "url",
    "artifactId": "https://www.thegamer.com/skyrim-every-daedric-prince-realm/",
    "publishedTime": "2025-12-20T08:02:11.679537Z",
    "lastUpdateTime": "2025-12-29T18:10:13.563503Z",
    "priority": false,
    "texts": [
      {
        "language": "en",
        "title": "Skyrim: Every Daedric Prince and Their Realm of Oblivion",
        "fullText": "While the Nine Divines and several other deities in the Elder Scrolls series reside within the realm of Aetherium, this is only one of many divine realms that the mortals of the series have tried desperately to reach for various reasons. The most prevalent and recurring of these is the realm of Oblivion, which is divided into various planes. Even though Oblivion is generally seen as a single realm, it is actually made up of multiple different planes that are inhabited by various divine and mortal beings, the most notable being the Daedric Princes. The Daedric Princes created their respective plane using pieces of their own bodies, which has made each plane of Oblivion vastly different from one another. However, they are all equally alien when compared to Nirn."
      }
    ]
  }
}

Request URL for scraping​

curl -X "POST" "https://api.clsfy.me/v1/scraping/request" \
     -H 'X-API-Key: 1234' \
     -H 'Content-Type: application/json; charset=utf-8' \
     -d $'{
  "url": "https://www.thegamer.com/skyrim-every-daedric-prince-realm/"
}'

Will return 201 Created upon success. 208 Already Reported if the URL has already been submitted.