team-31-interiit/toolforcer 📝 → ❓

▶️ 14 runs 📅 Dec 2023 ⚙️ Cog 0.8.6
agent agent-orchestration agent-planning function-calling text-generation tool-planning tool-sequencing

About

ToolForcer: Predicting the sequence of tools so solve a query

Example Output

Output

{"tasks":[{"task":"Use the 'works_list' tool with the arguments 'type'=['issue'], 'created_by'='$$PREV[0]', and 'issue_priority'='P0'.","thought":"First, I need to identify my P0 issues to prioritize them and generate a summary.', ensures my filters P0 &inspire; created_by are used to get my issues.', summary of these issues expected as an output. '","tool_name":"works_list"},{"task":"Use the 'summarize_objects' tool with the output from the 'works_list' tool as argument 'objects'='$$PREV[0]'.","thought":"With the prioritized P0 issues, I need to summarize them for efficient addition to the sprint, or further action. ', it would be good to use only one call to summarize_objects.'","tool_name":"summarize_objects"}],"solution":[{"arguments":[{"argument_name":"type","argument_value":["issue"]},{"argument_name":"created_by","argument_value":["$$PREV[0]"]},{"argument_name":"issue_priority","argument_value":["P0"]}],"tool_name":"works_list"},{"arguments":[{"argument_name":"objects","argument_value":["$$PREV[0]"]}],"tool_name":"summarize_objects"}]}

Performance Metrics

35.68s Prediction Time
35.70s Total Time
All Input Parameters
{
  "query": "Prioritise my P0 issues and summarise them",
  "tools": "[\n    {\n        \"tool_name\": \"who_am_i\",\n        \"tool_description\": \"Returns the string ID of the current user\",\n        \"args\": [],\n        \"output\": {\n            \"argument_type\": \"str\",\n            \"is_array\": false,\n            \"is_required\": true\n        }\n    },\n    {\n        \"tool_name\": \"get_sprint_id\",\n        \"tool_description\": \"Returns the ID\\nof the current\\nsprint\",\n        \"args\": [],\n        \"output\": {\n            \"argument_type\": \"str\",\n            \"is_array\": false,\n            \"is_required\": true\n        }\n    },\n    {\n        \"tool_name\": \"works_list\",\n        \"tool_description\": \"Returns a list of work items matching the request\",\n        \"args\": [\n            {\n                \"argument_name\": \"applies_to_part\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": false,\n                \"argument_description\": \"Filters for work belonging to any of the provided parts\",\n                \"example\": [\"FEAT-123\",\n                \"ENH-123\",\n                \"PROD-123\",\n                \"CAPL-123\"]\n            },\n            {\n                \"argument_name\": \"created_by\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": false,\n                \"argument_description\": \"Filters for work created by any of these users\",\n                \"example\":[\"DEVU-123\"]\n            },\n            {\n                \"argument_name\": \"issue_priority\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": false,\n                \"argument_description\": \"Filters for issues with any of the provided priorities. Allowed values: p0, p1, p2, p3. The lower the value, higher the priority\"\n            },\n            {\n                \"argument_name\": \"issue.rev_orgs\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": false,\n                \"argument_description\": \"Filters for issues with any of the provided Rev organizations, using their ID\",\n                \"example\":[\"REV-123\"]\n            },\n            {\n                \"argument_name\": \"limit\",\n                \"argument_type\": \"int\",\n                \"is_array\": false,\n                \"is_required\": false,\n                \"argument_description\": \"The maximum number of works to return. The default is '50'\"\n            },\n            {\n                \"argument_name\": \"owned_by\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": false,\n                \"argument_description\": \"Filters for work owned by any of these users\",\n                \"example\":[\"DEVU-123\"]\n            },\n            {\n                \"argument_name\": \"stage_name\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": false,\n                \"argument_description\": \"Filters for records in the provided stage(s) by name\"\n            },\n            {\n                \"argument_name\": \"ticket_need_response\",\n                \"argument_type\": \"boolean\",\n                \"is_array\": false,\n                \"is_required\": false,\n                \"argument_description\": \"Filters for tickets that need a response\"\n            },\n            {\n                \"argument_name\": \"ticket_rev_org\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": false,\n                \"argument_description\": \"Filters for tickets associated with any of the provided Rev organizations (customers)\",\n                \"example\":[\"REV-123\"]\n            },\n            {\n                \"argument_name\": \"ticket_severity\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": false,\n                \"argument_description\": \"Filters for tickets with any of the provided severities. Allowed values: blocker, high, low, medium\"\n            },\n            {\n                \"argument_name\": \"ticket_source_channel\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": false,\n                \"argument_description\": \"Filters for tickets with any of the provided source channels\"\n            },\n            {\n                \"argument_name\": \"type\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": false,\n                \"argument_description\": \" Filters for work of the provided types. Allowed values: issue, ticket, task. Must be used, if arguments referencing tickets, issues or tasks are being used.\"\n            }\n        ],\n        \"output\": {\n            \"argument_type\": \"any\",\n            \"is_array\": false,\n            \"is_required\": true\n        }\n    },\n    {\n        \"tool_name\": \"summarize_objects\",\n        \"tool_description\": \"Summarizes a list of objects. The logic of how to summarize a particular object type is an internal implementation detail.\",\n        \"args\": [\n            {\n                \"argument_name\": \"objects\",\n                \"argument_type\": \"any\",\n                \"is_array\": true,\n                \"is_required\": true,\n                \"argument_description\": \"List of objects to summarize\"\n            }\n        ],\n        \"output\": {\n            \"argument_type\": \"any\",\n            \"is_array\": false,\n            \"is_required\": true\n        }\n    },\n    {\n        \"tool_name\": \"prioritize_objects\",\n        \"tool_description\": \"Returns a list of objects sorted by priority. The logic of what constitutes priority for a given object is an internal implementation detail\",\n        \"args\": [\n            {\n                \"argument_name\": \"objects\",\n                \"argument_type\": \"any\",\n                \"is_array\": false,\n                \"is_required\": false,\n                \"argument_description\": \"A list of objects to be prioritized\"\n            }\n        ],\n        \"output\": {\n            \"argument_type\": \"any\",\n            \"is_array\": true,\n            \"is_required\": true\n        }\n    },\n    {\n        \"tool_name\": \"add_work_items_to_sprint\",\n        \"tool_description\": \"Adds the given work items to the sprint\",\n        \"args\": [\n            {\n                \"argument_name\": \"work_ids\",\n                \"argument_type\": \"str\",\n                \"is_array\": true,\n                \"is_required\": true,\n                \"argument_description\": \" A list of work item IDs to be added to the sprint.\"\n            },\n            {\n                \"argument_name\": \"sprint_id\",\n                \"argument_type\": \"str\",\n                \"is_array\": false,\n                \"is_required\": true,\n                \"argument_description\": \"The ID of the sprint to which the work items should be added\"\n            }\n        ],\n        \"output\": {\n            \"argument_type\": \"boolean\",\n            \"is_array\": false,\n            \"is_required\": true\n        }\n    },\n    {\n        \"tool_name\": \"get_similar_work_items\",\n        \"tool_description\": \"Returns a list of work items that are similar to the given work item\",\n        \"args\": [\n            {\n                \"argument_name\": \"work_id\",\n                \"argument_type\": \"str\",\n                \"is_array\": false,\n                \"is_required\": true,\n                \"argument_description\": \" The ID of the work item for which you want to find similar items\"\n            }\n        ],\n        \"output\": {\n            \"argument_type\": \"str\",\n            \"is_array\": true,\n            \"is_required\": true\n        }\n    },\n    {\n        \"tool_name\": \"search_object_by_name\",\n        \"tool_description\": \"Given a search string, returns the id of a matching object in the system of record. If multiple matches are found, it returns the one where the confidence is highest\",\n        \"args\": [\n            {\n                \"argument_name\": \"query\",\n                \"argument_type\": \"str\",\n                \"is_array\": false,\n                \"is_required\": true,\n                \"argument_description\": \"The search string, could be for example customer (rev) name, part name, user name. Work items are not counted as objects\"\n            }\n        ],\n        \"output\": {\n            \"argument_type\": \"any\",\n            \"is_array\": false,\n            \"is_required\": true\n        }\n    },\n    {\n        \"tool_name\": \"create_actionable_tasks_from_text\",\n        \"tool_description\": \"Given a text, extracts actionable insights, and creates tasks for them, which are kind of a work item.\",\n        \"args\": [\n            {\n                \"argument_name\": \"text\",\n                \"argument_type\": \"str\",\n                \"is_array\": false,\n                \"is_required\": true,\n                \"argument_description\": \"The text from which the actionable insights need to be created.\"\n            }\n        ],\n        \"output\": {\n            \"argument_type\": \"str\",\n            \"is_array\": true,\n            \"is_required\": true\n        }\n    }\n]"
}
Input Parameters
query (required) Type: string
Input query
tools (required) Type: string
Tools to use
Output Schema

Output

Type: object

Example Execution Logs
Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.18s/it]
Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.54s/it]
Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.33s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.33s/it]
Version Details
Version ID
28085fc578ac7b5c219718f8688f26da6dd4e5bb98278f079bd714fe31b15ba5
Version Created
December 12, 2023
Run on Replicate →