Crawler Analyst

2 Days ago • All levels

Job Summary

Job Description

As a Crawler Analyst, you will automate information extraction from websites using an internal tool. This involves collaborating with the Bots (Python) team to solve website-specific challenges and suggesting improvements to the tool's developers. You will also check system logs to identify and address errors. Your responsibilities include automating information extraction for numerous websites using custom templates, updating templates to adapt to website changes, validating templates, and escalating complex ones to the Python development team. You are expected to propose elegant and reliable solutions, provide feedback for tool improvement, and proactively identify and address problems.
Must have:
  • Experience in crawling, scripting, programming, coding is required.
  • Good knowledge of HTML, XPATH and regex is essential.
  • Experience working with Linux environments (grep, awk, etc.).
  • Basic knowledge of using Docker or similar tools.
  • Familiarity with Agile methodologies (Scrum, kanban, Jira Suite).
  • Some familiarity with Python, although you will not use it frequently.
  • Knowledge of Git as a version control system.
  • Good level of spoken and written English is required.
Good to have:
  • More experience in Python is beneficial.
  • Some experience working with Proxies.
  • Ability to find solutions by observing logs.
Perks:
  • Top-notch Private Health Insurance, fully covered by the company.
  • 23 working days of holidays per year, plus the local public holidays.
  • Indefinite Contract.
  • Reduced working hours on Fridays and throughout August.
  • Tax relief/ ¨Retribución Flexible¨ will also be available.
  • Discount with DIR gyms!
  • Referral policy with a Bonus scheme.
  • Hybrid model, with a flexible start time.
  • Fresh fruit, and a huge variety of different kinds of milk, coffee, tea, and cereals at the office.
  • Monthly after works and internal events.

Job Details

Company Description

What's Red Points all about?

Red Points is the most widely used solution to recover digital revenue. Over 1.000 companies rely on our platform to fight counterfeits, piracy, impersonation, and distribution abuse. They leverage Red Points to take back the revenue that’s rightfully theirs. With 270+ professionals and offices in New York, Barcelona, Beijing, and Salt Lake City, Red Points has disrupted an industry traditionally led by service providers with a scalable, cost-effective solution. 

Be part of the change: join us on our mission to make the Internet a safer place!

Job Description

The Role

As our Crawler Analyst, you will work using our internal tool to automate information extraction from websites. Every site has its own challenges so you’ll have to collaborate with the Bots (Python) team (and occasionally other teams and departments) to solve them as you learn, as well as with the developers of this tool to propose improvements. You also have to check system logs to detect possible errors in production and deduce if something is not well defined in terms of development.

Responsibilities

 

  • Automate information extraction for hundreds of websites using custom templates.
  • Keep extraction procedures working as websites change by updating templates (YAML files)
  • Validate current templates and escalate the more complex ones to the Python development team.
  • Thinking about elegant, reliable, and long term solutions. 
  • Provide feedback about the tool so that we can improve it and make the job easier over time.

Qualifications

You

  • Have strong analytical and technical problem-solving skills.
  • Have strong communication and organizational skills.
  • Be able to work well in a team and autonomously.
  • Be flexible and able to adapt easily to changes and learn quickly.
  • Be able to learn new skills and tools using documentation and examples.
  • Be proactive and propose solutions to detected problems, and think about how to improve the process.

Requirements

  • Experience in crawling, scripting, programming or coding is required, especially good knowledge of HTML, XPATH and regex.
  • Experience working with Linux environments (grep, awk…)
  • Basic knowledge of using Docker or similar tools.
  • Familiarity with Agile methodologies (Scrum, kanban, Jira Suite...)
  • Some familiarity with Python, although you will not use it frequently.
  • Knowledge of Git as a version control system.
  • Good level of spoken and written English (we are an international team and the official language in the office is English)

Nice to have

  • More experience in Python will help you to solve and detect problems easily with our tool.
  • Some experience working with Proxies.
  • Ability to find solutions by observing logs.

Additional Information

What we offer

  • A friendly, diverse, and international team.
  • You’ll have top-notch Private Health Insurance, fully covered by the company.
  • 23 working days of holidays per year, plus the local public holidays.
  • Indefinite Contract.
  • Fridays we have reduced working hours. And every weekday during August.
  • Tax relief/ ¨Retribución Flexible¨ will also be available for you.
  • We offer a discount with the amazing DIR gyms!
  • We have a Referral policy with a very sweet Bonus scheme.
  • We have a hybrid model, with a flexible start time. 
  • At the office, we offer fresh fruit, and a huge variety of different kinds of milk, coffee, tea, and cereals.
  • We also host monthly after works and internal events that allow us to share good times together and learn something new!

We are an equal opportunity employer and value diversity at our company. We encourage all applicants, regardless of race, religion or belief (if any), color, nationality, ethnic or national origin, gender, gender identity, pregnancy and maternity, sexual orientation, age, marital and civil partnership status, or disability status.

If you think this is the right move for you and you match the description, just apply! We'll get in touch with you for an interview if you are one of the selected candidates. 

Similar Jobs

Nagarro - Associate Principal Engineer, CRM Salesforce

Nagarro

(On-Site)
6 Months ago
Brillio - For testing purpose - R01539561

Brillio

London, England, United Kingdom (Hybrid)
6 Months ago
Insight  Software - Principal Software Engineer (Full Stack)

Insight Software

Hyderabad, Telangana, India (On-Site)
3 Weeks ago
Google - Software Engineer III, Full Stack, Corporate Engineering

Google

Hyderabad, Telangana, India (On-Site)
2 Days ago
commerce iq - Software Development Engineer II - UI Platform

commerce iq

Bengaluru, Karnataka, India (On-Site)
18 Hours ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Critical mass - Technology Director - Digital Platform

Critical mass

San Jose, California, United States (On-Site)
8 Hours ago
ByteDance - Tech Lead Manager - Fullstack-Customer Service Platform-SG

ByteDance

Singapore (On-Site)
6 Months ago
AGS - American Gaming Systems - Graphic Designer

AGS - American Gaming Systems

Nevada, United States (On-Site)
1 Week ago
FalconX - Salesforce Developer / Admin

FalconX

Bengaluru, Karnataka, India (On-Site)
7 Hours ago
ByteDance - Frontend Software Engineer - Customer Service Platforms - Seattle

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
The Walt Disney Company - Senior Software Engineer (Project Hire)

The Walt Disney Company

Celebration, Florida, United States (On-Site)
2 Weeks ago
Canva - Senior Frontend Engineer - Editing APIs

Canva

Adelaide, South Australia, Australia (Remote)
1 Month ago
Google - Software Engineer III, Full Stack, Learning and Education

Google

Mexico City, Mexico City, Mexico (On-Site)
2 Weeks ago
Zenoti - Senior Product Specialist

Zenoti

Costa Rica, Mato Grosso Do Sul, Brazil (On-Site)
1 Day ago
Dun & Bradstreet - Account Executive, Outbound - Manage (R-16769)

Dun & Bradstreet

Jacksonville, Florida, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Barcelona, Catalonia, Spain

The Workshop - Data Software Engineer

The Workshop

Málaga, Andalusia, Spain (Hybrid)
8 Months ago
Monzo - Senior Software Engineer

Monzo

Barcelona, Catalonia, Spain (Hybrid)
8 Hours ago
Fanatee - Jr. Technical Product Manager

Fanatee

Spain (Hybrid)
1 Month ago
Mozilla - Staff Machine Learning Engineer, Gen AI

Mozilla

Spain (Remote)
6 Months ago
Scopely - Senior Motion Graphics Designer

Scopely

Barcelona, Catalonia, Spain (Hybrid)
4 Months ago
Scopely - Principal Economy Designer - Unannounced Project

Scopely

Barcelona, Catalonia, Spain (Hybrid)
3 Months ago
Scopely - Manager, Executive Recruiting

Scopely

Barcelona, Catalonia, Spain (Remote)
3 Months ago
Redpoints  - Sales Development Representative (SDR)

Redpoints

Barcelona, Catalonia, Spain (On-Site)
2 Months ago
LeoVegas - Senior Backend Engineer - Retention/Sports/iGaming

LeoVegas

Málaga, Andalusia, Spain (Hybrid)
6 Months ago
Ubisoft - Data Analyst

Ubisoft

Barcelona, Catalonia, Spain (Hybrid)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Barcelona, Catalonia, Spain (On-Site)

Barcelona, Catalonia, Spain (On-Site)

Barcelona, Catalonia, Spain (On-Site)

Barcelona, Catalonia, Spain (On-Site)

New York, New York, United States (Hybrid)

Barcelona, Catalonia, Spain (On-Site)

View All Jobs

Get notified when new jobs are added by Redpoints

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug