research step
Research Loop
Initialization
Look at the mission.md file in the current directory. This is the current research mission to perform reserach on.
If there is NOT a mission.md file, exit this skill with a message saying:
- "Please add a mission.md file to the current directory describing your research task/mission. See examples at https://tinyurl.com/example-missions"
Otherwise, continue.
Setup
Look to see if there is a research_state.md file in the current directory.
If there is one, go to the Research step below (next heading).
If there is NOT one, then create it as follows:
Background: This file, research_state.md, is to be a LIVING RESEARCH document for keeping track of research progress for the research mission (mission.md), that you can use in collaboration with other researchers working with you. The idea is that both you and the other researchers can contribute to the document, use it for inspiration as next steps, and each update information in the documents as the research continues.
Action: Create a research_state.md file and write into it your own initial hypotheses and observations about the mission, to help get started. It is fine to leave sections blank until future research fills in the details. Where appropriate, include your rough confidence estimates (as a percentage) in the document. The document should help new researchers join the effort, and quickly learn about what we know and what we don't, and where in the research process the team is, and what tasks should be done next, so that they can easily see where to contribute.
To help plan your research, you will later have tools you can use including:
- literature-report: for literature search
- run-experiment: end-to-end autonomous experimentation
- directly asking questions to a LLM
- other tasks
Now, here is a suggested structure for the LIVING RESEARCH document research_state.md.
- Research Question & Scope
- Operational Definitions
- Related Work
- Hypotheses (H1, H2, H3, ...)
- Experimental Designs
- Results Summary
- Open Questions & Confusions
Research
Finally, run a single iteration of the following research loop:
- Read the research_state.md file to understand the current research mission and current state
- Analyze what has been done and decide the next concrete TASK to perform
- Summarize relevant background knowledge / context that is needed to understand TASK and perform it correctly. Create a file background_knowledge.txt and write that summary into it. If background_knowledge.txt already exists, overwrite it.
- Select and invoke the most appropriate skill for that subtask. For example:
- To code up and run a software experiment, use the run-experiment skill (which invokes the Panda research tool).
- To survey, summarize, or assess the literature, use the literature-report skill.
When that task has been completed:
-
Make a backup copy of research_state.md to the "history/" folder: a. Look in the "history/" directory for backup copies of research_state.md, e.g., "research_state-bk1.md", "research_state-bk2.md". If the directory doesn't exist create it. b. Place a backup copy of research_state.md in the "history/" directory, called "research_state_bk.md" where N is the next unused number (1 if this is the first backup).
-
UPDATE the main research_state.md with the results, so that the current state of research is up to date, including a correct summary of what has been done, what is still to do, and what has been learned. research_state.md should be ready then for the next iteration of the research.
-
Append a short paragraph entry to the END of the file logbook.md summarizing what was done. (If logbook.md doesn't exist, create it). The entry should be of the form: "## Step :
<paragraph> "
where is the next step number (start at 1), is a few words summarizing the step, should very briefly say what was done and what happened (e.g., a sentence or two for each of these.
End
Exit with the message "Iteration complete"
More from allenai/asta-plugins
asta literature reports
Create or update literature reviews/reports. Use whenever you need to research, summarize, or synthesize the literature.
32asta library
Local document metadata index for files used by Asta skills and tools. Use this skill when the user asks to store a document "in Asta" or retrieve "from Asta". Use it when the
31pdf text extraction
Extract text from PDFs using olmOCR or remote OCR. Use when user asks to "extract text from PDF", "OCR a document", "read a PDF", or needs to process scanned documents.
25