Senior Engineer

• *Job Description: Senior Full\-Stack Software Engineer** ***Position Overview***

We are seeking a Senior Full\-Stack Software Engineer with at least 7 years of experience in full\-stack software development, web crawling, network protocol analysis, and enterprise data telemetry. In this role, you will bridge the gap between application architecture, web scraper engineering, network traffic analysis, and data analytics.

Using Node.js as your primary backend environment, you will design automated crawling engines, analyze client\-side rendering mechanics, monitor live application traffic in New Relic, and join web\-level findings with data warehouse records to produce high\-impact analytical reports. **Key Responsibilities**

1\. Full\-Stack Engineering \& Web Crawling

Full\-Stack Development: Architect, develop, and maintain robust services and analytics applications using Node.js (TypeScript/JavaScript) on the backend along with modern frontend frameworks.

Scalable Web Crawling: Design and scale high\-throughput crawling suites using Node.js automation libraries (Playwright, Puppeteer) to inspect complex DOM structures, handle dynamic client\-side rendering, and extract structured metadata.

DOM \& Rendering Analysis: Evaluate the browser rendering lifecycle—including HTML/CSS parsing, JavaScript execution, DOM tree construction, layout, and visual paint—to detect client\-side performance bottlenecks or script execution failures. **2\. HTTP Protocol \& Network Traffic Analysis**

Network \& Payload Inspection: Perform deep\-dive analysis on inbound and outbound HTTP/HTTPS traffic, inspecting request/response headers, status codes, cookies, session tokens, payloads, and API endpoints.

APM \& Traffic Patterns: Monitor real\-time traffic volumes, request distribution, latency metrics, and error rates using New Relic (or equivalent APM systems) to detect operational anomalies and traffic spikes.

Full\-Trace Mapping: Correlate client\-side event triggers and tracking calls with server logs, microservice calls, and backend API responses. **3\. Data Warehouse Integration \& Reporting**

Data Warehouse Querying: Write complex, optimized SQL queries and manage data pipelines to extract and aggregate large\-scale records from platforms like Snowflake, BigQuery, or Amazon Redshift. **Data Synthesis:** Merge web crawling datasets, HTTP payload logs, and APM telemetry with warehouse transaction history to perform root\-cause analysis and pattern identification.

Technical Reporting: Build and deliver comprehensive technical reports, automated executive dashboards, and actionable recommendations for product, platform, and data teams. **Required Qualifications**

Professional Experience: 7\+ years of hands\-on experience in full\-stack software engineering, with a strong focus on backend systems, web scraping, and data\-driven web analytics.

Node.js Expertise: 7\+ years of deep technical proficiency in Node.js (TypeScript/JavaScript), microservices architecture, and asynchronous runtime performance tuning.

Frontend Mechanics: Master\-level understanding of HTML5, CSS3, JavaScript/TypeScript runtime engines, browser rendering paths, DOM structures, and DevTools.

Browser Automation: Demonstrated track record building resilient, production\-grade scrapers using Puppeteer, Playwright, or Selenium within a Node.js ecosystem.

Networking \& Protocols: Expert knowledge of network protocols (HTTP/1\.1, HTTP/2, HTTPS), RESTful APIs, GraphQL, CORS, cookies, and HTTP request/response lifecycle mechanics.

Telemetry \& APM: Hands\-on expertise with New Relic or similar enterprise monitoring suites to analyze system performance, network payloads, and user traffic behavior. **Preferred Qualifications**

5\+ years in a senior or lead technical capacity guiding web architecture, data engineering pipelines, or scraping infrastructure.

Data Warehouse \& SQL: Advanced SQL skills and extensive experience extracting, transforming, and loading data across cloud data warehouses (Snowflake, BigQuery, Redshift).

Familiarity with bypassing advanced anti\-bot protections, IP rotation systems, and browser fingerprinting challenges.

Practical experience deploying serverless microservices (AWS Lambda, Cloudflare Workers) for distributed web crawling tasks.