Engineering Expert

Engineering Expert – AI Evaluation (Simulation \& Design)

• *Compensation:** $500 per approved task
• *Engagement Type:** Short\-Term Contract (24 weeks)
• *Experience Required:** 10\+ years of hands\-on engineering design experience
• *Availability:** Up to 40 hours per week, with at least 4 hours of overlap with Pacific Standard Time (PST)
• *Work Arrangement:** Remote

About the Role

We are seeking experienced engineering professionals to help evaluate and improve advanced AI systems through challenging engineering simulation and design tasks.

In this role, you will create complex engineering problems, validate simulation\-based solutions, evaluate AI\-generated outputs, and identify reasoning or tool\-use failures. You will work across electrical, mechanical, aerospace, control systems, and related engineering domains to develop rigorous benchmarks that test the technical capabilities of AI agents.

This opportunity is ideal for engineers with deep design expertise, strong Python programming skills, and practical experience using engineering simulation tools.

Key Responsibilities

• **Engineering Problem Design:** Create challenging, self\-contained engineering design problems with competing constraints, clear optimization objectives, validated reference solutions, and automated grading criteria.
• **Simulation and Tool Integration:** Build, execute, and validate engineering simulations using open\-source tools and custom Python test benches.
• **AI Output Evaluation:** Assess AI\-generated engineering solutions and review execution logs to identify reasoning errors, incorrect tool usage, and technical failures.
• **Failure Analysis:** Investigate issues such as physically impossible designs, incorrect interpretation of simulator feedback, and premature convergence on unsuitable solutions.
• **Benchmark Development:** Refine task difficulty using performance data while ensuring technical accuracy, clarity, and reproducibility.
• **Technical Validation:** Verify physical plausibility, unit consistency, boundary conditions, convergence criteria, and documentation quality.
• **Collaboration:** Work with AI researchers, technical leads, and engineering specialists to improve AI evaluation benchmarks.

Required Qualifications

• Master’s degree or PhD in Electrical Engineering, Mechanical Engineering, Aerospace Engineering, or a closely related discipline.
• At least **10 years of hands\-on engineering design experience**.
• Strong Python scripting and programming skills.
• Proficiency in at least one relevant open\-source engineering simulation or design tool, such as:
• **Electrical and circuit simulation:** ngspice, PySpice
• **Computational fluid dynamics and finite element analysis:** OpenFOAM, FEniCSx, CalculiX, Gmsh
• **Control systems and dynamic modeling:** python\-control, OpenModelica, Cantera
• **CAD and engineering design:** CadQuery, build123d
• Strong analytical and troubleshooting skills, with meticulous attention to technical detail.
• Ability to develop reference solutions and validate engineering results against defined constraints and objectives.
• Availability for weekend on\-call work as required.
• A personal desktop or laptop and a stable, high\-speed internet connection suitable for remote work.

Preferred Qualifications

• Hands\-on experience working with modern large language models (LLMs), AI coding agents, or AI evaluation workflows.
• Familiarity with AI evaluation concepts such as pass@k, failure\-mode analysis, and nondeterministic model behavior.
• Experience reviewing execution logs or tool\-use trajectories to identify underlying reasoning failures.
• Experience developing automated tests, objective graders, engineering benchmarks, or reproducible simulation environments.
• Experience across one or more of the following domains:
• Electrical Engineering
• Mechanical Engineering
• Aerospace Engineering
• Control Systems
• Systems Engineering
• Robotics

Contract Details and Availability

• **Duration:** 24 weeks.
• **Compensation:** $500 per approved task.
• **Workload:** Availability for up to 40 hours per week.
• **Time\-zone requirement:** At least 4 hours of overlap with Pacific Standard Time (PST).
• **Weekend availability:** Required for on\-call support as needed.
• **Work location:** Remote.

This is a task\-based contract. The advertised rate is per approved task, not an hourly wage or guaranteed weekly salary. Actual earnings will depend on task availability, completion, and approval.

How to Apply

Please submit your resume highlighting your engineering design experience, academic qualifications, Python proficiency, simulation tools used, and any relevant experience with AI evaluation, automated testing, or technical failure analysis.

Pay: ₹47,000\.00 per day

Benefits

• Work from home

Work Location: Remote