Pinned to Announcements

• 2 You must be logged in to vote

  📣

  v0.6.0: Docker & Kubernetes Support, "Code Repair" and "Transpilation" task types, Static code repair

  bauersimon announced Jan 15, 2025 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  Deep dive: OpenAI's o1-preview is the king 👑 of code generation but is super slow and expensive

  bauersimon announced Jan 15, 2025 in Announcements

  

  

  0

Discussions

• 2 You must be logged in to vote

  📣

  Deep dive: DeepSeek v2 Coder and Claude 3.5 Sonnet are more cost-effective at code generation than GPT-4o!

  bauersimon announced Jan 15, 2025 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  v0.5.0: Ollama, Mac + Windows, OpenAI API Support, More Complex "Write Test" tasks, Metrics, Native support for multiple runs

  bauersimon announced Jan 15, 2025 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  Deep dive: Is Llama-3 better than GPT-4 for generating tests? And other deep dives of the DevQualityEval v0.4.0

  zimmski announced May 2, 2024 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  v0.4.0: Java as a new language, automatic Markdown report with SVG chart, and super reliability

  zimmski announced Apr 26, 2024 in Announcements

  

  

  0
• 1 You must be logged in to vote

  📣

  v0.3.0: First README and final name of the benchmark: DevQualityEval

  zimmski announced Apr 4, 2024 in Announcements

  

  

  0
• 1 You must be logged in to vote

  📣

  First evaluation result is online: Can LLMs test a Go function that does nothing?

  zimmski announced Apr 8, 2024 in Announcements

  

  

  0