Best Practices
Use Ask Devin to scope out tasks:- Instead of needing to write a detailed specification from scratch, interactively plan and construct a Devin prompt with Ask Devin.
- Think through your TODOs, and carve out small tasks that a team of Devins can help with.
- Return to draft PRs waiting for review.
- Devin is great for tasks that take 30 minutes but often end up in large backlogs for weeks.
- Ideally, it’s as easy as checking that CI passes or testing an automatic deployment. Avoid ambiguous tasks where it can seem like the task was completed properly but something else is happening.
- As you’re getting started, start many small runs to find the best use cases for Devin.
- Try to keep sessions short (XS, S, or M as measured by Session Insights), as longer running and larger sessions degrade Devin’s performance.
Evaluating Tasks for Devin
When deciding if a task suits Devin, the first question to ask yourself is: Could a junior engineer figure this out given enough time and context?Pre-Task Checklist
Task Complexity- Consider what judgment calls and hard decisions are needed
- Identify potential failure routes
- For tasks requiring advanced domain knowledge, break them down further or provide relevant context
- Good tasks have a clear start and end, plus success criteria (e.g., passing tests, matching an existing pattern)
- Are there examples or patterns for Devin to follow?
- Can you provide prototypes, partial code, or existing patterns from the codebase or docs?
- Are there links or filenames for Devin to refer to?
- Tasks with test suites, lint checks, or compilation steps yield better results
- Tasks with subjective standards can be trickier to validate
- Ideally, you just need to see that CI passes, or you can quickly test an automatic deployment
- For large tasks, consider breaking them down into sub-tasks or multiple sessions
- Splitting large requests into smaller, manageable chunks helps Devin stay on track
Post-Task Review
Monitor Session Trajectory- Leverage Session Insights to investigate the session timeline and identify actionable feedback for future sessions
- If Devin repeatedly encounters session usage limits, the task assigned to it might be too complex
- If Devin is struggling with its dev environment, revisit the Workspace setup
- In your future sessions, provide more context or instructions to help Devin get past previous obstacles
- Consider adding or approving Knowledge so Devin remembers things it learned from previous sessions
