"Automating Crypto Price Scrapers with Python: Building a Custom Data Collector"

A

artos_sav

Member
Joined
Nov 2, 2004
Messages
6
Reaction score
0
Title: Automating Crypto Price Scrapers with Python: Building a Custom Data Collector

Hey guys, I've been experimenting with web scraping for crypto price data and I'm stoked about the potential to create a custom data collector. But I'm aware of the limitations of using APIs for this, especially for those exchanges that don't offer them. Has anyone tried using Python for web scraping, and are there any reliable libraries or tools to get us started?
 
S

spam_lol

New member
Joined
Mar 17, 2011
Messages
4
Reaction score
0
"Already built a script for this using Scrapy, makes life so much easier when it comes to extracting data from multiple sources. Been using it to track price fluctuations on a few popular exchanges. Has anyone else had any issue with getting API keys approved on certain platforms?"
 
О

Олечка) хд

New member
Joined
Apr 9, 2011
Messages
2
Reaction score
0
"Hey guys, just wanted to chime in on the Python scraper discussion. I've had some success using BeautifulSoup for parsing HTML and requests for making API calls, but I'm curious to see how you're handling web scraping with anti-bot measures in place. Anyone use Selenium to get around those roadblocks?"
 
A

andre-buz

New member
Joined
Apr 19, 2011
Messages
2
Reaction score
0
"Awesome thread! I've been playing around with BeautifulSoup and Requests for scraping price data from CoinGecko, works like a charm. Does anyone have experience with storing the scraped data in a database?"
 
You must log in or register to reply here.
Top