LLM Evaluation & Agents
668 open positions
-
Staff Software Engineer, AI ThomsonreutersIndia, Bengaluru, Karnataka 6d Drive innovation in document intelligence by developing advanced AI solutions for document classification, information extraction, reasoning, and automation using Large Language Models (LLMs).
-
Senior Software Engineer AppleCupertino, United States of America 6d Build evaluation systems, tooling, and reward models for Siri to ensure quality signals are trustworthy across iOS, iPadOS, macOS, watchOS, and visionOS.
-
DE&A - AIML - Machine Learning - Python↗ Zensar TechnologiesIN 6d Build prescriptive and generative AI components that translate model outputs into actionable business recommendations, bridging data science outputs with production-ready deliverables.
-
Junior Applied AI Engineer IlluinParis La Défense 6d Design and develop custom Data Science solutions and products with high impact for clients, users, and society.
-
Software Engineer, Model Capabilities NotionSan Francisco, California $255k–$255k6d Own the model layer of Notion AI, integrating frontier models, ensuring reliable inference at scale, and building new model-level capabilities for product teams.
-
Forward Deployed Machine Learning Engineer RaydarRemote $170k–$170k6d Design and build production benchmarks and evaluation systems for foundation models across domains and modalities, including sandboxed environments for agentic evaluations.
-
Member of Technical Staff RunwayUSA 6d Own the end-to-end evaluation platform for generating, annotating, reviewing, and adapting model evaluations at scale for frontier models.
-
Software Engineering IC2 MicrosoftUnited States, Washington, Redmond 7d Design, implement, and refine software solutions while defining key scenarios and end-user experiences for large features.
-
AI & Software Engineer Akkodis Sweden ABGöteborg, Sweden 7d Develop and deploy AI and LLM solutions to automate and support software engineering processes and development workflows.
-
大模型应用策略实习生（J105500） Baidu北京市 7d Intern role focused on applying and optimizing state-of-the-art large language models in real business scenarios to drive NLP innovation.
-
Freelance Technical Consultant TolokaRemote 7d Design and implement data labeling pipelines and act as a trusted technical advisor for customers to build scalable AI solutions.
-
Graduate Software Engineer MaincodeMelbourne 7d Building and maintaining Matilda, an Australian-made AI production system for inference and model training.
-
Software Engineer, Machine Learning EmaVancouver, BC 7d Building and deploying production-level machine learning models for NLP, retrieval, ranking, reasoning, dialog, and code-generation systems to enable an Agentic AI platform that delegates tasks to an 'Universal AI Employee'.
-
Analista de IA↗ Instituto de Pesquisas EldoradoCampinas, SP, BR 7d Build, train, evaluate, and maintain AI solutions for document processing, similarity analysis, and recommendations, including LLMs, RAG systems, and MLOps pipelines.
-
Research Engineer (CHILL)↗ National University Of SingaporeQueenstown, S00, SG 7d Develop and iterate an in-house AI generation pipeline to convert Continuing Education and Training course content into short, narrative microlearning modules.
-
Software Engineer, Computational Policy Lab Harvard-UniversityCambridge, MA, us 8d Build and deploy generative AI and machine learning tools for education technology and public policy research, including randomized controlled trials.
-
Senior AI Engineer, Post-Training CartaSan Francisco $242k–$242k8d Lead end-to-end post-training of open-weight LLMs on proprietary legal data for Carta's autonomous AI agents and legal tech platform.
-
TEMPORARY - AI Engineer R&D↗ Nova Southeastern UniversityClearwater, FL, US 8d Research, design, and deploy human-centered AI solutions focusing on LLM training, fine-tuning, and RAG pipelines.
-
?AI Engineer Intern↗ HR, IN $195k–$195k8d Develop and deploy AI systems for automating academic workflows including question paper generation, moderation, and answer sheet evaluation.
-
Machine Learning Engineer, Monetization AI/ML OpenAISan Francisco 8d Design and deploy advanced machine learning models to solve real-world monetization problems, turning research breakthroughs into production AI applications.
-
?AI/ML Intern↗ MH, IN $12k–$24k8d Assist in developing and implementing Machine Learning and Artificial Intelligence solutions, including Generative AI and LLM applications.
-
Senior AI Evaluation Engineer #AIDA↗ SingtelSingapore, S00, SG 8d Design, calibrate, and adjudicate evaluation suites and gate thresholds for AI/ML agent archetypes to ensure model quality and drift hygiene.
-
Remote Java Developer↗ TuringRemote 8d Create cutting-edge datasets for training, benchmarking, and advancing large language models by curating code examples, providing solutions, and correcting code primarily in Java.
-
Machine Learning Intern, 2027 Summer U.S.↗ AtlassianSan Francisco, CA, US $94k–$94k8d Build and evaluate applied AI/ML solutions for real-world product and business problems, contributing to recommendation systems, governance, or foundational ML platforms.
-
-
Senior Machine Learning Engineer ByteDanceUSA 11d Develop and improve machine learning and large language model systems for code generation, unit test generation, debugging, and building AI-powered developer agents.
-
Software Development Engineer II, Compliance and Safety Services, Amazon Stores, Compliance and Safety Services (CoSS), Amazon Stores
AmazonBucharest, Romania
11d
Build ML automation and AI models using LLMs and SLMs to automate compliance controls and mitigate product safety risks at global scale.
-
Senior Software Engineer, Search Platforms, LLM Evaluation Infrastructure↗
GoogleKA, IN
11d
Architect, build, and maintain high-throughput, low-latency platform services and orchestration pipelines for automated evaluation and benchmarking of Generative AI (GenAI) Search experiences.
-
Prompt Engineer With MCP↗ Tech Aalto Pte ltdSG 11d Develop and refine prompts to optimize GitHub Copilot usage for coding tasks like generating snippets, fixing bugs, and writing unit tests.
-
-
Stage de fin d’études — LLM-as-a-Judge : évaluation automatique, fiabilité et qualité des modèles d’IA (H/F) WavestonePuteaux, IDF, fr 12d Designing an automatic evaluation framework based on LLM-as-a-Judge to assess the reliability, bias, and quality of generative AI and agent solutions.
-
AI Product Engineer MathspaceRemote 12d Lead the development of intelligent learning experiences powered by large language models (LLMs) and generative AI to provide personalized, real-time math guidance to students and teachers.
-
Machine Learning Engineer MicrominePerth, Western Australia 12d Develop evaluation frameworks, benchmarks, and metrics to measure and improve the performance of LLM and agent-based AI systems for the mining industry.
-
AI Engineer Tech AaltoSydney, New South Wales 12d Design, develop, and optimize prompt strategies for generative AI models to deliver cutting-edge solutions for Public Sector clients.
-
Senior Data Scientist - AI Startup↗ HaysHong Kong, Hong Kong SAR 12d Design, develop, and deploy advanced AI and machine learning solutions for customer-facing products and internal business operations.
-
-
AI Engineer / KI-Spezialist (w/m/d)↗ Auftragnehmerkataster ÖsterreichWien, W, AT $39k–$47k12d Design, develop, and integrate AI solutions (ML, NLP, Document AI, GenAI, LLMs) into existing applications for the Austrian public procurement sector.
-
Grupo QuintoAndar | Senior Data Scientist (Women Applicants Only) QuintoAndarRemote 12d Architect, develop, and deploy machine learning systems (including LLM-powered applications) to production for search, recommendation, and customer experience enhancement in the real estate sector.
-
Technical Program Manager HudRemote 12d Own complex, time-sensitive data and evaluation programs for frontier AI labs, data vendors, and internal teams to ensure data is useful for evaluating and improving LLMs and agents.
-
AI Engineer / KI-Spezialist (w/m/d)↗ Ankö Service Ges.M.B.H.Wien, W, AT $39k–$47k12d Design, develop, and integrate AI solutions (ML, NLP, Document AI, GenAI, LLMs) into existing applications, moving from Proof-of-Concept to production deployment.
-
Software Engineer, Tokens and Prompt Structures AnthropicSan Francisco, CA $320k–$320k13d Design and maintain encoding libraries and prompt structures that enable Claude to consume text and multimodal data, bridging research experiments to production systems.
-
Product-Focused Data Scientist (LLM Products) BlueroseresearchRemote $160k–$160k13d Build LLM-powered research and analysis tools for political campaigns to enhance strategy development and communication.
-
Senior Staff Machine Learning Engineer, Ads Ranking RedditRemote $293k–$293k13d Define and accelerate the use of agentic AI to transform machine learning models and modeling workflows, focusing on enhancing model quality and velocity.
-
-
AI Forward Deployed Engineering (AI FDE) Intern↗ UniversRemote, SG 13d Intern role developing AI solutions for real-world operational challenges across industries by turning ambiguous problems into clear AI use cases and building practical solutions.
-
AI Engineer Intern (Machine Learning)↗ Mikomiko Pte. Ltd.Queenstown, S00, SG 13d Design, train, and optimize core machine learning and deep learning models to power AI systems for AIGC generation and smart automation.
-
Data Scientist with Python and LLM experience-2↗ RealignPlano, TX, US 13d Building and optimizing data science solutions using AI/ML, NLP, Deep Learning, and LLMs to address complex business problems.
-
Software Developer - Marcom, Sales and Delivery Services↗ SiemensKA, IN 13d Design and develop AI models, convert them into APIs, and perform statistical analysis on big data sets to drive innovation and diverse business outcomes.
-
Junior AI Engineer↗ Eurotux Informática, S.a.Braga, P03, PT 13d Develop Machine Learning and AI solutions for real business problems, including predictive modeling, LLMs, and Agentic AI architectures.
-
Browse by specialty
AI Data AlignmentAI EngineeringAI Software EngineeringAndroid DevelopmentApplied AI StackAutomotive AndroidAutomotive EmbeddedAvionics SoftwareBackend EngineeringBackend Web QABrowser Extension DevBusiness IntelligenceC# BackendC# Full StackCloud SecurityConversational AI QACross-Platform MobileData & ETL QAE-Commerce BackendEmbedded LinuxEngineering ManagementEnterprise IntegrationEntry-Level EngineeringERP System QAField Service TechFinTech BackendGame Engine DevGenAI CloudGeneral FrontendGPU Compiler EngHardware VerificationHigh-Frequency TradingIndustrial AutomationiOS DevelopmentIT Support QAJava BankingJava EnterpriseJava FrontendJava MicroservicesMainframe DevelopmentManual Software TestingMedical Device SWML InfrastructureMobile App QANetwork FirmwareNode.js BackendNode.js Full StackPerformance TestingPHP Web DevQA LeadershipReact FrontendRobotics SimulationRPA AutomationSalesforce & Identity QASalesforce EngineeringSAP ABAPSecure Systems TestingSecurity ProductsServiceNow EngineeringSoftware EngineeringSoftware EngineeringSoftware EngineeringSoftware Engineering LeadershiTest AutomationWeb Automation QA
Agile Release ManagementAI InfrastructureAI InfrastructureAI Platform EngineeringApplication DevOpsAWS Kubernetes EngineeringAzure Cloud InfrastructureAzure DevOps EngineeringBroadcast & OSP EngineeringCarrier Network OperationsCloud InfrastructureCloud InfrastructureCloud Infrastructure EngineeriData Center FacilitiesDefense & Security PlatformsDesktop & IT HelpdeskDevSecOps & ClearanceEmbedded Linux & ASICEndpoint ManagementEngineering Systems AdministrationEnterprise Network AdministrationExecutive IT SupportFinancial Trading SystemsFintech Platform EngineeringGCP Cloud EngineeringGlobal Technical SupportHPC & Liquid CoolingHybrid Cloud SREIndustrial Automation & SCADAIntegration & RPAIT Infrastructure LeadershipIT Service ManagementLinux Systems EngineeringMainframe & MiddlewareManaged Cloud OperationsModern Workplace CollaborationNetwork Automation & SDNObservability EngineeringOpenShift & Container PlatformPhysical Infrastructure ProjectsPlatform EngineeringPublic Sector DevOpsSAP Basis AdministrationServiceNow Platform EngineeringSite Reliability EngineeringSolutions ArchitectSpace & Mission SystemsStorage & BackupTelecom & Hybrid ReliabilityWindows Systems Administration
Ad Tech and RankingAdministrative Compliance AnalyticsAds & Personalization MLAgentic AI WorkflowsAI Agents and SafetyAI Automation AnalyticsAI Language TrainingAI Strategy and ArchitectureAnalytics EngineeringApplied GenAI ConsultingAutonomous Driving MLAWS Databricks EngineeringAzure Data EngineeringBI Analytics EngineeringBI Visualization EngineeringBiological Discovery ResearchBiostatistics and SafetyClinical Data EngineeringClinical Laboratory ScienceComputational GenomicsComputer Vision EngineeringComputer Vision LocalizationConsulting Data ScienceConversational AI EngineeringCredit and Fraud RiskCrypto and AI ResilienceData EngineerData EngineerData EngineerData EngineerData Engineering LeadershipData Governance ComplianceData Governance EngineeringData Infrastructure AnalyticsData Science InternshipsData Strategy LeadershipDatabase AdministrationDecision Science AIDigital Marketing AnalyticsE-commerce Data EngineeringEdge AI HardwareEnterprise Data ArchitectureEntry Level InternshipsEnvironmental and GeoscienceFinancial Data EngineeringFinancial Strategy AnalyticsFood Science ResearchForward Deployed AIFraud Risk AnalyticsGCP Data EngineeringGeneral Data PlatformGenerative AI EngineeringGenerative AI SystemsGeospatial GIS AnalyticsGovernment AI SecurityHealthcare Data ScienceHealthcare Risk AnalyticsHEOR and Clinical AIHPC ML EngineeringHR Data IntegrationHR People AnalyticsInformatica Data EngineeringInsurance Actuarial AnalyticsInsurance and ActuarialIT Operations AnalyticsJava Python Data EngKnowledge Graph EngineeringLaboratory Quality AnalyticsLife Sciences AILLM Core EngineeringLLM Evaluation & AgentsLogistics Operations AnalyticsManufacturing Data SystemsManufacturing Process AnalyticsMarket Economics ResearchMarketing ExperimentationMicrosoft Fabric DataMLOps EngineeringPalantir Foundry EngineeringPharma Analytical ChemistryPharma Process DevelopmentPhysical AI DataProcurement Sourcing AnalyticsPublic Health ResearchQuantitative Finance ResearchQuantum and ImageryRisk & Fraud MLRobotics and PerceptionRobotics ML EngineeringSAP BW DataSAP Master DataSearch & Recommendation MLSecurity and ClearanceSnowflake Data EngineeringSnowflake DBT EngineeringSpeech AI EngineeringSupply Chain ForecastingSupply Chain Planning
AI Product SecurityApplication Security EngineeringCloud Infrastructure SecurityCloud Security AssessmentDetection EngineeringEmbedded Firmware SecurityEnterprise Application SecurityFacility Security ManagementGeneral Cyber DefenseGovernance Risk ComplianceIdentity & Access ManagementNetwork Firewall EngineeringOffensive Security TestingOT Industrial SecurityPhysical Guard ServicesPhysical Security EngineeringPrivacy and AI GovernanceSecurity Architecture LeadershipSecurity Program ManagementSecurity Solutions SalesSOC OperationsThreat Intelligence AnalysisVulnerability ManagementVulnerability Research
Academic Product EngineeringAdobe Experience PlatformAgile Scrum MasteryAI Agent EnablementAI Content CreationArchitectural & Interior DesignAutonomous Vehicle ProductsBanking Product DesignBroadcast Production ManagementBusiness Systems AnalysisContact Center TechnologyConversation UX DesignCreative Agency DesignCybersecurity Product ManagementData & ML ProductsDefense Systems ManagementDeveloper Tools ProductDigital Health PlatformsE-commerce MerchandisingEngineering CAD DesignEnterprise Solution ArchitectureEvent & Studio TechFrontend Engineering ManagementGame & Level DesignGaming Product ManagementGenerative AI SolutionsGovernment SaaS ProductsHealthcare AI StrategyHRIS Product ManagementIndustrial Product DesignInfrastructure & ObservabilityInstructional Design & LMSInsurance Claims TechnologyInsurance Product ManagementIT Project ManagementITSM & CRM ArchitectureLegal Tech ProductsNPI Program ManagementPLM Solution ArchitectureProduct AnalyticsProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagementProduct ManagerSalesforce Product OwnershipSAP ERP SolutionsSemiconductor Product EngineeringSmart Manufacturing AISupply Chain Product ManagemenTechnical Program ManagementUI/UX Design SystemsUX Research
Aerospace Manufacturing QAAerospace Systems EngineeringAerospace Systems TestAnalog IC DesignASIC Physical DesignASIC Verification EngineeringAutomotive Repair TechnicianAutomotive Systems EngineeringAutonomous Vehicle QACivil Structural EngineeringCNC Machining & FabricationConstruction Project ManagementElectrical Inspection & SafetyElectronics Test EngineeringEmbedded Firmware EngineeringEnvironmental Health & SafetyFacilities Maintenance EngineeringField Service EngineeringHVAC Design EngineeringIndustrial Automation ControlsIndustrial Construction QAIndustrial Maintenance EngineeringLandscaping & Yard OpsManufacturing Process EngineeringMaterials & Chemical LabMechanical Product DesignNetwork Hardware QAPCBA Test EngineeringPharmaceutical Manufacturing EngineeringPhotonics Test EngineeringPower Electronics DesignPower Systems EngineeringProduction OperationsRF & Avionics DesignSemiconductor Process EngineeringSilicon ValidationSpacecraft Mechanical EngineeringSubstation Automation QA
Account-Based Demand GenAI Product MarketingApparel Retail ManagementBanking Relationship SalesContent Communications MarketingEnterprise AI SalesEnterprise Customer SuccessEnterprise Security SalesExperiential Sports MarketingFrontline Service SalesGeneral Business DevelopmentHealthcare Brand MarketingHigh-Incentive Sales RepsIndustrial Technical SalesIndustrial Territory SalesInsurance Lines SalesMarketing Analytics OperationsPartner Channel StrategyPayments Business DevelopmentPerformance Paid MediaPharmaceutical Clinical SalesProcurement Supply ChainRetail Trade MarketingSales Compensation OperationsSales Development RepsSEO Digital MarketingSocial Creative DesignTechnical Solutions Engineering
Automotive OperationsBanking Operations & LendingCommodity & Indirect SourcingCompliance & Contact QACompliance ManagementConstruction & Electrical ProjectsContinuous Improvement & LeanCulinary & Kitchen StaffCustodial & Building ServicesCustomer ServiceDelivery & Traffic CoordinationEducational & Correctional ProgramsEHS Compliance & SafetyEngineering Executive LeadershipEnvironmental Permitting & CarbonERP & WMS SystemsEvent Production & ConcertsExecutive & GTM RecruiterExecutive & Legal AdministrationFacilities Management & OperationsFood Safety QAGeneralist & Early Talent RecruiterGrocery Produce & DeliHealthcare OperationsHealthcare Staffing RecruiterHospitality Concessions & BarHR Business PartneringHR Operations & PayrollIT & Program ProcurementLast Mile LogisticsMaintenance Planning & ReliabilityMajor Construction Project ControlsMaterials & Inventory ControlMission & Defense OperationsOperations & TrainingOperations ManagementOperations ManagementOrganizational Change ManagementPlant & Operations LeadershipProduction Planning & SchedulingProduction SupervisionProject Coordination & AdminPublic Sector Project ManagementReal Estate & Land DevelopmentRestaurant General ManagementRetail Softgoods OperationsRobotics Deployment ProjectsSemiconductor & IE OperationsSpanish Market QAStudent Life & FraternitySupplier QualitySupply Chain StrategyTechnical & Manufacturing RecruiterTextile & Garment QCWarehouse & Distribution OperationsWarehouse Material Handling
Accounts PayableActuarial PricingBusiness AnalyticsCommercial FinanceCorporate DevelopmentCorporate Governance ComplianceCorporate TaxCost AccountingCredit RiskERP SystemsFinance AI InnovationFinancial Crime ComplianceFinancial ReportingFP&A AnalysisFrench Financial QAFund AccountingHealthcare RevenueInternal AuditPayments EngineeringPayroll AdministrationProject ControlsPublic AccountingQuality AuditingQuantitative TradingReal Estate FinanceRetail BankingSAP FinanceSurety UnderwritingThird-Party RiskTreasury OperationsWealth Advisory
Acute Care NursesBehavioral HealthCardiac Imaging TechsCardiology PhysiciansClinical DataClinical DevelopmentClinical EngineeringClinical InformaticsClinical LaboratoryClinical PharmacyClinical Project MgmtClinical Research AssociatesClinical SpecialistsComputer System ValidationDentistryDietary ServicesEmergency MedicineHealthcare RecruitingHospitalistsInfection ControlLab QC OperationsLaboratory ManagementLaboratory Quality ControlLong-Term CareMedical AssistantsMedical CodingMedical Device QAMedical Device TechsMedical EducationMedical Science LiaisonsMedical WritingNurse Case ManagersNursing AdministrationOccupational HealthOncologyPediatricsPharma Manufacturing QAPharmacovigilancePrimary CarePrivate MedicalPsychiatry PhysiciansQuality and ValidationRadiology PhysiciansRadiology TechnologistsRegulatory AffairsRehabilitation TherapistsResearch CoordinatorsRespiratory TherapistsRetail PharmacySurgerySurgical TechsTelehealth ProvidersVeterinary Medicine
Biomedical and Civil EngineeringBioprocess & AnalyticalComputational Biology and GenomicsCore Facility ResearchCorporate AI ResearchEnergy Systems & AIFaculty Administration and MedicineGeneral Academic ResearchGeneral Postdoctoral ResearchHealth Behavior StudiesMaterials and Quantum ScienceNeuroscience & PsychologyNeuroscience and NeurologyPharmacometrics & RegulatoryPhysics and Energy ResearchPolytechnic Engineering InstructionQuantum & AcceleratorRobotics & AITenure-Track FacultyTraditional Campus Instruction
← Select a job to preview