Data Engineer – Python

Asiawise Lanka Pvt Ltd

Colombo Full Time Posted 3 weeks ago
LocationColombo
Job TypeFull Time
SalaryNegotiable
Closing Date2 Jan 2027

Job Overview

Asiawise Lanka Pvt Ltd is hiring a Data Engineer – Python for a full-time, remote role. The position focuses on designing and maintaining Python-based web scraping and data collection systems, structured data storage, and AI-driven automation.

Position Details

  • Job Title: Data Engineer – Python
  • Employment Type: Full-Time
  • Work Arrangement: Remote

Organization Overview

Asiawise Lanka Pvt Ltd is a Sri Lanka-based company offering this position on a fully remote basis.

Qualifications & Experience

  • Bachelor’s degree in Computer Science, Engineering, or a related field
  • 2 years of proven work experience in a similar role
  • Proficiency in Python with a focus on data scraping and automation
  • Strong experience with web scraping frameworks such as Scrapy, BeautifulSoup, or Selenium
  • Experience working with APIs and handling authentication (e.g., OAuth, tokens)
  • Hands-on experience designing and implementing AI agents or autonomous systems using Python and related frameworks
  • Knowledge of data storage systems like MySQL, PostgreSQL, or MongoDB
  • Ability to write clean, scalable, and well-documented code
  • Basic understanding of SEO and product ranking mechanisms is a plus
  • Preferred: experience with e-commerce platforms like Amazon, eBay, or Shopify

Key Responsibilities

  • Design, develop, and maintain Python scripts for web scraping and data collection from target websites
  • Extract relevant product data including title, price, rating, availability, and listing position
  • Implement scraping solutions using libraries like BeautifulSoup, Scrapy, Selenium, or Playwright
  • Store and manage extracted data in structured formats (e.g., CSV, JSON, SQL, NoSQL)
  • Create dashboards or reports to visualize product performance and positioning
  • Monitor and adapt to changes in website structure to ensure scraping continuity
  • Ensure all scraping activities comply with legal and ethical guidelines

Required Skills

  • Strong Python programming and web scraping expertise
  • API integration and authentication handling
  • Experience with AI agents or autonomous systems built in Python
  • Database knowledge (MySQL, PostgreSQL, MongoDB)
  • Clean, scalable, well-documented coding practices

Salary & Benefits

  • Competitive salary, negotiable based on experience and qualifications
  • Fully remote work arrangement

How to Apply

Interested candidates should submit their CVs to hire@asiawise-lanka.com, with the applied position mentioned in the subject line.

Important Notes

  • This is a fully remote position
  • Applications should clearly state the position being applied for in the subject line