About the role
We are looking for resourceful and exceptional candidates for the Data Engineer role within our product development teams based out of Hyderabad, Bengaluru, and Gurugram. At DESIS, the Data Engineers develop Web Robots, or Web Spiders, that crawl through the web and retrieve data in the form of HTML, plain text, PDFs, Excel, and any other format that is either structured or unstructured. The job functions of the engineer also include scraping the website data into a structured format and building automated and custom reports on the downloaded data that are used as knowledge for business purposes. The team also works on automating end-to-end data pipelines.
What we're looking for- The ideal candidate should hold- Basic qualifications: ─ 1-6 years of experience in website data extraction and scraping ─ Good knowledge of relational databases, writing complex queries in SQL, and dealing with ETL operations on databases ─ Proficiency in Python for performing operations on data ─ Expertise in Python frameworks like Requests, UrlLib2, Selenium, Beautiful Soup, and Scrapy ─ A good understanding of HTTP requests and responses, HTML, CSS, XML, JSON, and JavaScript ─ Expertise with debugging tools in Chrome to reverse engineer website dynamics ─ A good academic background and accomplishments ─ A BCA/MCA/BS/MS degree with a good foundation and practical application of knowledge in data structures and algorithms ─ Problem-solving and analytical skills ─ Good debugging skills