Developer Mode (Beta)
Developer mode in the Lens Studio AI allows you to leverage AI in the process of building your Lens. Ths mode incorporates small AI tools that allow you to perform various actions within Lens Studio (e.g. list SceneObjects, setProperty, etc.). These tools are extendable (through plugins called ChatTools) and also accessible through the MCP server and can be utilized in the scripting editor of your choice.
Take a look at the Example Prompt to see an example prompt for your code editor / software that can help improve its performance with Lens Studio.
Interacting with the panel
-
You can enable Developer mode by toggling the mode drop-down at the bottom of the chat panel where the chat box is.
-
You can try one of the example prompts by clicking on them, and presssing enter. Notice that you can ask it to analyze your scene, ask it to debug, add things from the asset library, find trending music, and more!
-
Key to the way Developer mode works is the tools it has access to. These tools allow an AI agent to interact with Lens Studio
Interacting with the AI
-
For example, if you ask the AI what's in the scene, it will call the built in
Get Scene Graphtool to give you the answer.
-
You can ask it to modify your scene. In some cases, the AI will use multiple tools to answer your prompt.
-
You can provide follow up request as well.
AI will start to lose context the longer conversation becomes, so at times you might want to start a new conversation to make sure it doesn't lose focus.
-
You can ask the AI to add interactivity, and it will try to make a script for you.
-
If you have an an error in your project, or the AI makes a mistake, you can ask it to double check its work, or help you fix it.
-
To help you learn, the AI will give you instructions on how to do the things you want to achieve. But you can tell the AI to do it for you as well!
Adding Additional Tools
As you start to develop more specialized Lenses, you might want to add your own tools.
Tools are just Lens Studio plugins, that extends the ChatTool class.
You can find additional ChatTool in the Asset Library
Once installed, you will find it in the tools list.
You can also add a Chat Tools by pressing the Add New Tool in the tool configurator.
Since these are just tools, you can manage them in the Lens Studio Preferences. You can even include a folder with many tools, and share it with your team!
Using Lens Studio AI with other LLM
You can expose these various tools using MCP to be accessed by other AI agents, or code editors.
In the Lens Studio menu bar, you can click on the AI Assistant > MCP > Configure Server to start an MCP server that allows your other software to drive Lens Studio.
In the popup window, click Start Server, and then Copy MCP Config.
In your clipboard, you will get something like this:
{
"servers": {
"lens-studio": {
"headers": {
"Authorization": "[some key]"
},
"type": "http",
"url": "http://localhost:8732/mcp"
}
}
}
You can use these settings in the software of your choice. Refer to your software's documentation for how to use these configuration.
Take a look at the Example Prompt that you may use for your code editor / software that can help improve its performance with Lens Studio.