Skip to main content

​
Overview

Devin is your tireless web scraping assistant. It can build web scrapers or even do repetitive web research and information gathering tasks itself!

​
Use Cases

  1. Web scraping and data collection
  2. Automated data extraction
  3. Converting scraped data to structured formats
  4. Handling both static and dynamic web content
  5. Browser automation for repetitive tasks
  6. Building automated data collection pipelines using the API Reference

​
Example Prompts

Scrape emojis
Use this (https://github.com/muan/unicode-emoji-json) to write a function that converts a string like https://www.gstatic.com/android/keyboard/emojikitchen/20201001/u1f600/u1f600_u2615.png to "grinning_face_warm_beverage" by extracting the 2 emojis (u1f600, u2615) and converting them to actual emojis.
Scrape website
## Overview
This playbook can be used to scrape a website and return the results to the user, along with the client-side and server-side scraping scripts used to generate the results.
Download logos
Please find and download the logos of 50 of the Fortune 500 companies.

​
Example Sessions

​
Emoji Data Processing

Scrape Emojis Learn how to parse and convert emoji Unicode data from GitHub repositories into human-readable formats. This session demonstrates working with JSON data sources and string manipulation for emoji processing. https://app.devin.ai/sessions/4f8a7b129820493b9c0ca140cddede50

​
YouTube Content Extraction

Scrape YouTube Playlist Discover how to programmatically extract video metadata from YouTube playlists. This session covers using Python to access video titles, descriptions, and other playlist information while respecting YouTube’s terms of service. https://app.devin.ai/sessions/8c6edbbb0bce4b70acd09255e1994c0b

​
E-commerce Data Collection

Scrape Ebay Data Learn techniques for gathering product information from eBay listings at scale. This session explores automated web scraping approaches for collecting prices, descriptions, and seller information while handling pagination and rate limiting. https://app.devin.ai/sessions/dc70fe0649cb4041852da384e65d42be
⌘I