Software / Platform / Data Engineer — Agent Trace Collection

• Build the technical implementation of a system that captures GitHub Copilot CLI agent traces across developer machines, scrubs sensitive content centrally in Azure, and serves a sanitized, queryable dataset for review.
• Own the pipeline end-to-end — from the endpoint capture script to the Azure ingestion, scrub, and viewer.
• Stand up the OpenTelemetry capture path: endpoint env-var/.bashrc setup, OTLP export, and a collector pipeline (receivers → processors → exporters).
• Build the central ingestion + privacy scrub block in Azure (secret + PII detection/redaction) before any data reaches a reviewer.
• Wire up the sanitized stores and a read-only trace viewer, with task↔session↔trace correlation.

• If you can take a written design and ship the working pipeline mostly on your own.
• Treat privacy as a hard requirement, not an afterthought.
• 5+ years in software / platform / data engineering, shipping production systems.
• 3+ years hands-on with Azure (or a comparable major cloud with clear transfer to Azure PaaS)
• 2+ years building observability or telemetry pipelines with direct OpenTelemetry experience — OTLP, collectors, spans/traces, semantic conventions.
• Experience with Azure PaaS: Container Apps/AKS, API Management, ADX/Kusto or App Insights, ADLS Gen2/Blob, Key Vault, Entra ID.
• Solid Python or Node.js, plus Bash scripting.
• Practical data privacy / PII & secret scrubbing experience (regex, entropy, redaction/tokenization).
• Data-pipeline and cloud-security fundamentals (RBAC, private networking, audit).

• Grafana / telemetry-backend setup
• LLM-agent or GenAI observability exposure
• Cross-cloud identity federation (AAD ⇄ GCP IAM)

RequiredAlso useful

Project and contracting process: Turing. Applications continue on the provider's website.