A whole site — into a text base for a neural net

The scenario crawls the site, gathers links, grabs page text, tidies it up and lays it out in a sheet.

  • Crawls the site by its links
  • Separates images from pages
  • Grabs and tidies the text
  • Lays it all out in a sheet
Set it upScriptera

How it works

To move data from asproCloud to automatically, use a ready-made scenario — no manual exports.

  1. Starts when: Manual Trigger
  2. Then: Set Website
  3. Then: Scrape Homepage
  4. Then: Extract Links from HTML
  5. Then: Split Links
  6. Then: Remove Duplicate Links
  7. Check: Filter Real Hyperlinks
  8. Check: Separate Images and Links
  9. If yes: Aggregate Images
  10. Then: Add Images to Sheet
  11. If no: Aggregate Links
  12. Then: Add Links to Sheet
  13. If no: Scrape Content Links
  14. Then: Convert to Markdown
  15. Then: Aggregate Scraped Content
  16. Then: Add Scraped Content to Sheet

You can launch this integration in Scriptera: describe the task in plain words — the scenario is built, launched and monitored for you.

Similar scenarios