Vetting Rubric & Evaluation Scorecard

Supabase • Candidate Evaluation

Role: Senior Software Engineer | Level: Senior Software Engineer (5-8 Years) | Stack: Python,Kubernetes
Ref: VET-202610-2F7E02
Date: October 27, 2026

Candidate Details & Interview Panel

Candidate Name: ___________________________ Lead Interviewer: ___________________________
English CEFR Level: [ ] B2 Working [ ] C1 Fluent [ ] C2 Native Timezone Overlap: [ ] Full (8 hrs) [ ] Partial (>5 hrs)

Weighted Evaluation Matrix (100 Points Total)

1. System Architecture & Scalability (25% Weight • Max 25 pts)
1
2
3
4
5
Score: _____ / 5
Ability to design fault-tolerant, scalable distributed systems, balance latency/cost trade-offs, and anticipate production failure modes.
2. Language & Framework Mastery (25% Weight • Max 25 pts)
1
2
3
4
5
Score: _____ / 5
Deep understanding of language semantics, runtime internals (memory, garbage collection, event loop), standard library idioms, and ecosystem best practices.
3. Production Debugging & SRE Observability (20% Weight • Max 20 pts)
1
2
3
4
5
Score: _____ / 5
Systematic root-cause analysis under incident pressure, mastery of APM/profiling tools, log tracing, and zero-downtime deployment practices.
4. English Articulation & Technical Communication (15% Weight • Max 15 pts)
1
2
3
4
5
Score: _____ / 5
C1/C2 CEFR professional English fluency, clear architectural diagramming, proactive documentation, and constructive code review etiquette.
5. Async Autonomy & Remote Timezone Reliability (15% Weight • Max 15 pts)
1
2
3
4
5
Score: _____ / 5
Self-directed execution, proactive blocker escalation, high async documentation discipline, and seamless US timezone collaboration habits.

Technical Inquiry & Coding Verification

Q1: How does the Python asyncio event loop manage cooperative multitasking, and what happens when CPU-bound synchronous code is executed inside a coroutine?
• Ideal Response: Candidate explains that the event loop runs on a single thread. Calling blocking synchronous code stops the entire loop, starving all other ...
• Red Flag: Thinks async/await automatically parallelizes across multiple CPU cores without an executor or multiprocessing.
Q2: In a high-throughput Django or FastAPI service querying PostgreSQL, how do you diagnose and resolve database connection pool saturation?
• Ideal Response: Candidate discusses PgBouncer or SQLAlchemy connection pooling parameters (pool_size, max_overflow, pool_timeout), holding connections open ...
• Red Flag: Suggests simply increasing max_connections to 5,000 on the database without evaluating connection RAM overhead or proxying.
Q3: A production service is experiencing random 502/504 errors during rolling deployments. How do you troubleshoot the root cause between Ingress, kube-proxy, and application pod lifecycle?
• Ideal Response: Candidate explains race condition: Pod receives SIGTERM, endpoints controller removes pod IP from Endpoints/EndpointSlice, but kube-proxy ip...
• Red Flag: Blames DNS caching without understanding kube-proxy iptables propagation latency or pod preStop hooks.
Live Coding Challenge: Idempotent Event Ingestion & Rate-Limited Deduplication Service
Implement a thread-safe / async memory-efficient event deduplicator that handles 10,000 req/sec with an sliding 60-second TTL window and sliding token-bucket rate limiter per API key.
Verification Criteria: Time complexity O(1), thread safety / atomic operations, proper cleanup of expired keys without memory leaks, clean unit tests.

Final Hiring Recommendation

[ ] STRONG HIRE
90 - 100 Points
[ ] HIRE
75 - 89 Points
[ ] LEAN HIRE
60 - 74 Points
[ ] NO HIRE
< 60 Points
Lead Interviewer Signature:
Date: ________________________
VP Engineering / Hiring Manager:
Date: ________________________