"Nobody can give you freedom. Nobody can give you equality or justice or anything. If you're a man, you take it." — Malcom X
- Companies Prospecting
- Distributed Crunchbase Company Scrape
- Contact Enrichment
- Customer.Io Upload
- Setup mitmproxy
brew install mitmproxy
- Start the mitmproxy to disable peremetrix
mitmproxy -s mitmproxy/crunchbase.py
- Setup ENV file (including AGENT_CODENAME)
- Build a list
rake list:build
- Upload the list
rake list:upload
- Take companies to scrape (550 Max)
rake agent:take
- Scrape with the following command
rake crunchbase:scrape
- Stop the scraper with
kill $(ps aux | grep '[s]crape' | awk '{print $2}')
Note: This uploads all contacts not just the ones assigned to the agent. It's best to run this after 5pm (MST) so that we can run enchance right after
rake contacts:process
rake contacts:enrich