Job Responsibilities: • Aggregate information from social media KOLs and blockchain news aggregation websites • Develop, optimize, and design the architecture and system planning for crawler engines and tasks; conduct research on crawling technologies • Perform data collection, parsing, cleaning, deduplication, distribution, and storage for crawlers, continuously improving collection efficiency • Bypass anti-crawling mechanisms, optimize crawler routing and scheduling strategies, and design and refine anti-anti-crawling strategies • Monitor crawler health and data quality to ensure stability, reliability, timeliness, and accuracy Qualifications: • Basic knowledge of blockchain concepts • Proficient in Python; experienced with mainstream open-source crawling frameworks such as Scrapy, Requests, UI Automator2, and Playwright • In-depth understanding of crawling principles and technologies; familiar with crawler design and implementation processes; 2–3 years of experience in internet data extraction and crawler system development • Strong command of MongoDB, Redis, message queueing, and MySQL; understanding of web front-end technologies including XHTML/XML, CSS, JavaScript, and AJAX • Familiar with anti-crawling mechanisms and able to implement effective bypass solutions • Excellent analytical and problem-solving skills; passionate about tackling challenging problems; strong team player with a high sense of responsibility Qualifications: • Basic knowledge of blockchain concepts • Proficient in Python; experienced with mainstream open-source crawling frameworks such as Scrapy, Requests, UI Automator2, and Playwright • In-depth understanding of crawling principles and technologies; familiar with crawler design and implementation processes; 2–3 years of experience in internet data extraction and crawler system development • Strong command of MongoDB, Redis, message queueing, and MySQL; understanding of web front-end technologies including XHTML/XML, CSS, JavaScript, and AJAX • Familiar with anti-crawling mechanisms and able to implement effective bypass solutions • Excellent analytical and problem-solving skills; passionate about tackling challenging problems; strong team player with a high sense of responsibility