Lens Studio Release Notes
4.55.1
Released December 13th 2023
New
- If you're experiencing consistent crashes while using Lens Studio, the Troubleshooting Lens Studio guide will help you address many issues and provide some recommendations for a more stable experience.
Improvements
- The Script Editor updated with information about latest API
- The Wrist Tracking model was updated
- Hand Tracking modes have been renamed for the hand tracking asset
Fixed
- Fixed an issue with Quazip library
4.55
Released September 13th, 2023
New
- Location AR’s World Mesh has been updated to World Mesh 2.0. With World Mesh 2.0, Lens Developers can take advantage of significantly improved accuracy, support, and precision of creating world meshes.
- World Mesh 2.0 also now supports reconstruction of a wide variety of outdoor spaces, which were previously unsupported.
- The Simple World Mesh and World Mesh Templates have been updated to utilize World Mesh 2.0.
- This update also enables Lens Developers to utilize the Custom Location Scan Lens on devices that do not have LiDAR functionality, opening up the range of devices you can use to create Custom Location AR Lenses This allows you to utilize World Mesh 2.0 in Custom Location AR Lenses.
- The Real-Time Neural Rendering ML Model enables building your AR assets from 2D images taken from your phone. With full compatibility for Snap ML, this model can be run on devices in real time.
- Lens Developers can also take advantage of a new Ray tracing feature: Diffuse Indirect Lighting. Diffuse Indirect lighting acts as a step towards Global Illumination, by providing a level of realism of how colors and lights can bleed and glow onto other objects.
- The Volumetric Cloud Template showcases how to render realistic clouds utilizing a ray marching technique. Volumetric Cloud materials have been highly optimized to run smoothly during run-time, letting Lens Developers take advantage of the feature in new AR experiences.
- AI-Powered Search BETA is new in Lens Studio documentation. Developers can conversationally get help by typing in a question and receive a well-structured, and relevant response that’s parsed through all Lens Studio docs and other learning materials. Use the shortcut Cmd / Ctrl + L to get started on any documentation page.
Improvements
- Along with Raytracing’s new Diffusion Indirect lighting feature, a few improvements have been made to assist in the creation of Raytraced powered Lenses:
- Enable MetalLibs export for Advanced Graphics Mode Lenses: Advanced Graphics Mode with metallib enabled export allows Lens Developers to export Lenses with precompiled shaders that will significantly improve loading time on IOS devices.
- An update to the LocalRay UI to have a dedicated Receiver include/exclude lists.
- Improved 3D Hand Tracking
- Snap is improving the existing 3D Hand Tracking solution on high-end mobile devices. We offer a new hand tracking model which produces more natural-looking hand shapes and better captures challenging hand poses, including partial overlap.
Fixed
- Fixed issue with 'AR custom location' template
- Fixed an issue where VFX with a high particle count would throw a script error.
- Fixed the problem where VFX assigned to a layer not rendered by a camera
- Fixed issue when shader compilation failed on VFX with Advanced Graphics Mode
- Fixed the inability to install the Old CC from the Asset library.
- Addressed the problem where Point Size from Overlay Camera reported the wrong value when targeting Live Target.
- Fixed the crash that occurred when opening a project if a function was set as a graph shader parameter.
- Fixed issue when LS app can crash when user is switching to different device simulation settings
- Fixed issue when user received multiple dialogs on import of 3d models
- Fixed the crash that occurred when trying to open a project with VFX containing a float parameter for the target position property of various AddForce subgraphs.
- Addressed the issue where the project generated multiple cross compiler errors even after removing resources and optimizing the project.
- Fixed the problem where not all effects were shown in the preview after successful shaders update.
- Resolved the issues related to the Content Editor Tools template, including no shaders update and long project closing times.
- Fixed the custom code node, which previously lacked the option to get UVs past 1.
- Resolved the crash that occurred after opening a project with frequent printing.
- Fixed issue with when Crop Texture become empty
- Addressed the increase in processing time for ML Models.
- Fixed the issue where LS froze upon project opening.
- Resolved the problem where the world tracking preview was broken in the Preview panel.
4.53
Released August 16th, 2023
New
- Lens Developers building City-Scale AR experiences will now be able to explore the area in an interactive environment in the Preview panel with the new Interactive Camera View.
- Through our partnership with OpenCV, Snap is providing a training notebook that allows you to train ML Models that support Optical Character Recognition.
- The Optical Character Recognition Template provides two parts to help Lens Developers get started with OCR; how to train a powerful OCR model, and a Lens Studio template.
- Lens Studio now offers the ability to utilize Pixels or Points, known as Device Independent Pixels, when adding a SceneObject to a Camera. When setting fields like size, padding, offsets or the various fields of the Layout Element, you can use the new device independent point unit instead of centimeters.
- The Meme Template offers Lens Developers an easy wsay to create movable screen sticker Lens by simply providing an image.
- The Quiz Template provides a convenient way to create quiz Lens by simply providing JSON data or directly editing the quiz in the Inspector panel.
- The Scene Manager Template demonstrates a few ways to use the Scene Manager Custom Component. Scene Manager allows you to break up your Lens into different pieces, reuse parts of Lenses, and improve overall Lens performance.
Improvements
- Major stability improvements, see the FIXED section to learn more.
- Support for ML Assets has been added to Remote Assets.
- Multiple performance improvements to VFX Editor assets, especially for projects that have a lot of VFX in the scene.
- Display Street Level Supported Area Info.
- Spotlights now has a Falloff option.
- PVR default for JPG in Lens Studio + template update.
- True Size support to Eyewear Try-On Template.
- Convert Graph GPU Particles to use instancing.
- The Particles Template has been updated to use the new Instancing GPU Particles.
Fixed
- Fixed issue when Lens Studio application may crash during undo for parameters on materials/shaders
- Fixed issue when textures were duplicated on project reopen
- Fixed issue when Serializated prefab script order does not match unserialized prefab of script
- Fixed issue when video textures and other resources have been duplicated on project reopen
- Fixed issue when Lens Studio application can be crashed on project reopen when unsupported entities have been added into project folders accidentally
- Fixed issue with getPixels function
- Fixed Lens Studio application crash with mp4 resource
- Fixed issue when Lens Studio application creates unused folders as resource
- Fixed issue when user can not see city map in Map panel
- Fixed issue when Lens Studio application crashes when printing the destroyed collider component
- Fixed issue when Lens Studio application crashes with old projects structure during scene objects selection
- Fixed issue with Project Info menu items
- Fixed issue when projects created on macOS won't open on Windows OS
4.49
Released June 22nd, 2023
New
- The Lens Performance Toolkit enables Lens Developers to view performance statistics of their Lens by pairing with their mobile device.
- Lens Studio’s scripting runtime has transition to utilize JavaScript ES6 to provide a more powerful, and more approachable solution for developers who are more familiar with the newer syntax. In addition it enables developers to use more shared libraries without having to make changes to them to work in Lens Studio.
- The Masking Component helps to make sure content is visible only within a certain window of the screen. It helps create an invisible frame that hides content when that content moves outside of frame.
- The Face Stickers Template allows you to quickly build a face sticker Lens. With this template, you can place any images or texts of your choice on positions relative to the face.
- The Necklace Try-On Template offers a quick way for you to get started with Necklace based AR Try-On Lens experiences.
- With the Eyewear Try-On Template, Lens Developers can create unique glasses AR Try-On experiences at professional level. The Eyewear Try-On Template offers a quick way for you to get started with Glasses based Try-On experiences.
- The ML Retouch features offers Lens Developers a way to switch this feature on for beauty Lenses, or any Lens that involves the front-facing camera, to naturally enhance a Snapchatter’s face while keeping unique facial features like freckles, beauty marks and more.
- The "What ___ Are You?" Template allows you to build your own unique spinner Lens by simply providing a list of words, images, colors, or a combination of them.
- Lens Studio now supports Machine Learning models from Roboflow.
Improvements
- Face Tracking effects working will now perform more optimally when used together with the Garment Transfer component.
- Footwear Try-On Template has been updated to a SnapML model that better detects the user’s foot and provides a better quality Try-On experience.
- The Earring Try-On Template has been updated to showcase additional features to enhance the user experience.
- Raytracing has been updated to improve performance out of the box
- Lens Studio Project Information has been updated to declare if a Lens will be a Camera Kit Lens directly within Lens Studio.
- City-Scale AR has been updated to showcase more in-depth information about how City-Scale AR Content works.
Fixed
- Fixed issue with vertex color on latest Nvidia drivers.
- Fixed issue with shaders/materials on latest Nvidia drivers.
- Fixed issue when remote assets rendered without textures.
- Fixed Tween Manager example.
- Fixed issue when LS crashed when trying to attach VSCode debugger.
4.46
Released May 3rd, 2023
New
- Hand and Nails Normals Maps allows developers to precisely add art to a user’s individual nails with a new subset of the Hand Segmentation Mask.
- Nail Segmentation is now out of beta and ready for public use.
Improvements
- The Garment Transfer Custom Component has been updated to include better quality rendering and support for a broader variety of textures and colors. This also includes the ability to create garments that feature animated content, the ability to provide a custom segmentation mask for garments and better target tracking.
- New Workflows and interactions has been included to make working with Location AR content easier in the Interactive Environment.
- Update Uber PBR material with code node.
Duplicate
selected button added for Animation Layer.- Range Type updated with
Frames
by default. - Improves behavior for custom component development to show unknown type widget for user via Logger with error and line number.
Fixed
- Fixed issue with Lens Studio freeze when Lens Studio is trying to compile TS files.
- Fixed issue when Lens Studio application can crash during HDR texture import.
- Fixed issue when project can not be open after resource corruption.
- Fixed issue when project can be corrupted after prefab import with custom component.
- Fixed issue when @type name inputs were cleared after resource import-export.
- Fixed issue when project can be corrupted when saved in cloud services.
- Fixed issue when specific prefab can freeze Lens Studio application.
- Fixed issue when project can be corrupted after import of specific prefabs which has VFX resource.
- Fixed issue when second mobile device which was paired with Lens Studio will not receive notification in Snapchat app after lens push.
- Fixed issue when user can received notification that shader needs to be updated for VFX asset.
- Fixed issue when Render Order was forced to AUTO for instantiated prefab.
- Fixed issue when user can not open project after fbx model was imported into it.
4.43
Released March 22nd, 2023
New
- Cubemaps offers Lens Developers the ability to apply multiple 2D Textures to an individual face of a cube to be used to generate effects such as skyboxes, reflections and unique lighting setups.
- The Cubemap Template showcases various ways Lens Developers can use cubemaps to create lightweight and complex lighting solutions.
- SnapML’s new Portrait Relighting introduces the ability to enhance or change the light and background of photos, as well as adding your own custom lighting to photos.
- The Gem Rendering Custom Component provides Lens Developers a way to reproduce the unique lighting effects in gemstones such as ruby, sapphires and diamonds.
- The Gem Rendering Template offers Lens Developers a quick way to get started with building Gemstone focused Lenses.
- The Physics Lab template in conjunction with the Content Editor Tools, teaches both Lens Developers and Snapchatters how to both author and play a simple physics-based game on device and from within Lens Studio.
- Lens Studio Visual Studio Code Extension has been released to the VSCode Marketplace to help streamline Lens Studio development in VSCode.
Improvements
- Lens Developers can now opt-out of using the Version Control Friendly Project Format.
- Support for Multiple Custom Locations in a single Lens.
Fixed
- Fixed crash of Lens Studio application when update materials dialog applied for Responsive Plants template
- Fixed issue when user received update materials button after project reopen instead of on state when assets were added into project
- Fixed issue when project can not be reopened on macOS after custom components was deleted from the project
- Fixed crash of Lens Studio application when project with VFX assets was optimized
- Fixed crash of Lens Studio application when import of ML model was canceled
- Fixed issue when user received unexpected user dialog in Lens Studio Tutorial
- Fixed issue when animated WebP asset imported as upside down
- Fixed issue when ‘getTimeLeft’ for delayed events returning elapsed time, not remaining time
- Fixed issue when Lens Studio application will not revert updated shaders to old version after Undo
- Fixed crash of Lens Studio application if script invalidates a physics body
- Fixed issue on Windows OS when user can not reopen project which was saved in folder connected with Google Drive
- Fixed issue when Connected lens template shows error level log if not hitting the join button
4.40.1
Released February 23rd, 2023
Improvements
- Optimized load time when opening a new project.
Fixed
- Fixed a crash affecting opening the City-Scale AR template.
- Fixed issue where changes to the node editor would not be saved as they’d get reverted on project-open.
- Fixed issue where submitting lenses with special characters in the name resulted in them getting trimmed.
- Fixed a crash caused by duplicating segmentation texture resources.
4.40
Released February 15th, 2023
New
- RayTracing in Lens Studio is a rendering technique to produce incredibly realistic looking images by simulating the way light behaves in the real world. With Lens Studio 4.40, the first set of Ray Tracing features include Real Time Reflections and RT Materials.
- While all features go through foundational testing and QA before release, it’s possible that certain technologies can impact delivery and performance of your Lens. Those first to leverage new capabilities take on the risk of unproven technologies in order to drive innovation and testing. For Sponsored Lenses in particular, make sure to follow our best practices for optimal File Size, Frames per Second (FPS), and other optimizations that are critical for success.
- The Ray Traced Reflections Template showcases how to get started with creating Ray Traced Reflections within Lens Studio.
- Lens Studio 4.40 now offers a new Version Control Friendly Project format to help you streamline collaboration on projects, especially when you’re working in teams.
- Multiple templates have been updated to reflect the new Version Control Friendly Project format.
- The Facial Features Segmentation Custom Component provides multiple segmentation options for creating different Face AR and Try-On experiences by utilizing different facial landmarks.
- Lens Studio now offers an offline mode when no internet connection is available.
- Sync Framework has been updated to address issues and includes two new templates to showcase how Sync Framework simplifies creating Connected Lenses.
- The Voting Template shows you how to use Sync Framework to build an AR experience that allows multiple users to contribute their input for selection in a shared session.
- The Gravity Gun Template, created by MousePack, offers Lens Developers a unique way to integrate your own physics-based tools within your Lens.
- [Beta] Nails Segmentation and Tracking enables Lens Developers to build unique Nail Try-On experiences.
- Multiple Hand Segmentation Masks are now supported.
- Lens Studio for Unity Developers is a new guide dedicated to helping Lens Developers bring their knowledge and experience from Unity to Lens Studio to build augmented reality experiences.
- The Performance and Optimization for Lenses guide provides more information on how best to optimize your Sponsored and Non-Sponsored Lenses and for a wide range of devices.
- The Asset Library has been updated to include the following features:
- The Asset Library is now treated as a panel within Lens Studio.
- New asset type “UI Hints” that encompasses new assets for Lenses.
- New Places API available in Asset Library.
- The Lens Analytics guide has been updated to inform Lens Developers about Event Insights and Community Audience, providing ways to learn more about how Snapchatters interact with your Lens
- The My Lenses portal has been updated to include Lens Submission Error Reporting to learn more about how to track any errors that may affect your Lens Submission.
- Render Target Scaling allows a Lens Developer to select their desired resolution scale from the UI, instead of having to code your own implementation.
Improvements
- Lens Studio Start Screen has been redesigned to create a better first time user experience.
- Lens Studio now Supports Lens and template names with special characters.
- Optional Parameters in Remote API Codegen are now supported.
- Print logs from pushed lens running on mobile
- Spot lights are now supported in Lens Studio.
- List of Devices in the Device simulation has been updated.
- TouchBlocking support for InteractiveComponent.
- Texture compression improvements.
- Support for Multiple Custom Locations in a single Lens.
- Face Mesh Reference has been updated to include 3D representation for Ears.
Fixed
- Video recorded on mobile device has wrong aspect ratio
- Fixed issues where materials would not render when pushed to devices.
- Fixed issue where the application would crash after the Scene Object under Prefab was duplicated and the change was applied.
- Fixed issue where the application would crash when trying to download remote assets via APIs.
- Fixed minor text alignment issue in Arabic.
- Fixed an issue where changing the blend mode for the last added image element caused all others with the same material to become translucent as they use the same darkened blend mode.
- Fixed issue when new layers are not automatically assigned to Light sources if previously layers were deleted.
- Fixed issue when Lens Studio crashed on import of HDR textures.
- Fixed issue when not used VFX resources were not deleted after optimization.
- Fixed issue when ‘Light Balancing’ custom component does not work with other custom components.
4.36.1
PLEASE DOWNLOAD FROM AR.SNAP.COM/DOWNLOAD TO UPDATE TO 4.36.1!
Released December 21st, 2022
New
- With LensFest 2022, The Snap AR Engineering team has created two new developer focused tools to help accelerate and streamline Lens Development:
- Sync Framework is a set of scripts and components designed to help you build Connected Lenses for building shared online multiplayer experiences.
- The Persistent Noteboard template features a note-taking Lens that utilizes the Canvas component and comprises two note-containers and an Input Modal for creating note entries.
- The Lens Quality Assurance Troubleshooting guide offers a series of tasks and examples of common bugs you may encounter when building Lenses and how best to resolve those issues.
Improvements
- New option in 2D scene toolbar to make ScreenTransforms save their screen space coordinates when being reparented.
- As previously mentioned in our Community Forum post, New Lens submissions using Wannaby Technology will be rejected in Lens Studio.
- Please note that existing Lenses using Wannaby Technology will continue to run in perpetuity, however they can no longer be updated.
- Best Practices for Remote Assets has been added as a way to help create a fluid user experience when building Lenses with Remote Assets.
- Update of autogenerated code to print error code and messages when API requests fail.
Fixed
- Fixed bug hiding autocomplete results in script editor.
- Fixed issue with 'Divide' node for specific mobile and desktop devices.
- Fixed issue when Custom Component file (.lsc) is showing as modified right after project reopen.
- Fixed issue when Custom Component typename input can disappear after project reopen.
- Fixed issue when Lens Studio can not be launched on macOS Ventura.
4.34
Released Nov 16th, 2022
New
- The Garment Transfer Custom Component provides a starting point for building photorealistic upper body garment try-on experiences by utilizing a single 2D image.
- Custom Structure Inputs allows creators to easily group data together based on their own defined data type.
- The ML Eraser Custom Component can be used to create unique in-painting effects within Lenses. In-painting allows removal of objects from camera feed based on a given mask, and realistically generates the missing areas.
- To showcase the new ML Eraser Custom Component, there are three new templates that Lens Developers can use:
- Paint to Erase showcases how users can paint on their screen to erase content in the world, how to utilize paint with Body Segmentation and how to create a dissolving effect with Paint.
- Disappearing Effect builds upon the ML Eraser and Body Segmentation to create unique effects such as a head slicing, hologram and pattern effect.
- World Eraser utilizes World Tracking and ML Eraser to showcase how users can erase content from the world independently from the camera.
- To showcase the new ML Eraser Custom Component, there are three new templates that Lens Developers can use:
- With the update to Custom Componƒents, Lens Developers can now create their own Custom Components. These Custom Components make it possible to build reusable, and shareable components with Lens Studio.
- New Try-On Custom Components and Templates have been designed to help accelerate Lens Developers in building fashion and shopping focused AR experiences:
- The Wrist Tracking Custom Component allows you to attach objects to the users wrist, such as watches and jewelry.
- Ear Binding is a new type of Custom Component that enables developers to build Try-On Lenses for earrings.
- The Foot Tracking Custom Component gives Lens Developers a more in-depth way to create custom Footwear Try-On Lenses.
- The Footwear Try-On Template has been updated to utilize the new Footwear Try-On Custom Component.
- Lens Developers can now export out their Custom Location AR Mesh to an OBJ file. This allows developers to adjust the Mesh in an external editor, and then import the Mesh back into Lens Studio.
- Custom Landmarker has been renamed to Custom Location AR.
Improvements
- Updated best practices for adding more perspective captures for Custom Location AR.
- Attachment Mode for Object Tracking.
- Updated Multi-Object Detection Template.
- New category
UI
is added into Asset Library. - Drag script asset into Objects hierarchy will create new object with script component.
- Auto codegen scripts for remote APIs is using JS modules now.
- Lens can now utilize special characters in their name.
- API upgrades for Location Resources: Creators can now create LocationMeshes and LocationTextures from script using
LocationRenderObjectProvider.create()
andLocationTextureProvider.create()
.- The City Scale AR template now uses these methods to create the 3x3 grid of "Relative Tile" Location Assets with LocationMeshes with LocationTextures.
Fixed
- Fixed Learn More link in icon creation window.
- Fixed issue when Asset Types Filter doesn't have Remote Asset Reference resource type.
- Fixed issue when Body tracking assets cannot be dragged onto Object Tracking 3D component.
- Fixed issue when Lens Studio will recreate Proxy Texture for ML and textures from materials will be duplicated as well.
- Fixed issue when both horizontal and vertical planes are emitted even if only one type is requested.
- Fixed issue when Audio Output template opens very slow on Windows.
- Fixed issue when Preview audio is unmuted on every lens reset.
- Fixed issue when duplicated/imported Pin is not displayed in Map panel.
4.31
Released Oct 5th, 2022
New
- Remote Assets offers developers a way to store assets within Lens Cloud to dynamically load their created content into Lenses at runtime. Since Remote Assets do not count against the Lens size limit, developers can build more complex Lenses and re-use assets across multiple Lenses.
- With this release of Remote Assets, developers can utilize assets up to 10MB per asset and a max of 25MB per Lens. Organizations can use up to 500 MB of space for storing assets.
- The Physics System has been updated to enable Developers to create Lenses with more realistic interactions and movement between AR objects in a scene. Some of the major features include;
- Support for Collision meshes, allowing collision, simulation, and ray casts against arbitrary render meshes.
- Correct handling of center-of-mass and inertia.
- Extend ray cast functions to support sweeping a primitive shape, such as a sphere, along a transform path.
- Support for collision filtering, enabling control over how colliders interact with one another.
- With the addition of Los Angeles and Santa Monica as new cities available in Lens Studio, creators can now build City-Scale AR content spanning across the multiple cities mapped in Lens Studio.
- The City Landmarker feature has been renamed to City-Scale AR.
- Canvas is a new Component that creates a dedicated root within the ScreenTransform hierarchy to dynamically place 2D Components, like Text and Image, in 3D space. The Canvas Component is built to adapt to multiple tracking solutions, giving Developers the flexibility to add more 2D AR enabled content to their experiences.
- Tooltips have been added to Lens Studio as a quick way to get information about how to use Lens Studio.
Improvements
- The new Hand Tracking solution has been added to Body Tracking.
- The Sounds section in the Asset Library has been renamed to Music to provide Lens Creators an easier way to add their favorite songs to Lenses.
- The glTF material and glTF Importer has been updated to support two new extensions:
KHR_materials_sheen
andKHR_texture_transform
. - Lens Studio Templates will now display the name of the Creator on the homepage.
- Added a dedicated Asset Library button in the Add Resources panel.
Fixed
- Fixed issue of broken Custom Code Node validation.
- Fixed issue when default envmap textures were deleted during component deletion.
- Fixed issue when studio may crash after copy a physics collider component.
- Fixed issue when Audio Component stops working once joined connected lenses session.
4.28.1
Released Sept 6th, 2022
Fixed
- Live Tracking now shows 3d model from the project instead of default.
- JS Docs have been updated update
- Face Occlusion template no longer opens with errors
4.28
Released August 24th, 2022
New
- With Spatial Persistence, users will be able to read or write AR content at a physical location and retrieve this data at the same physical location when they restart their lens.
- The new Spatial Persistence Template shows how Lens Creators can build AR content that is tied to a physical location in the world.
- Along with Spatial Persistence, The Content Editor Tools asset provides a set of plug-and-play custom components that enable users to place and manipulate persistent AR content
- The new Content Editor Tools Template showcases how to build persistent AR content where users can place and manipulate AR persistent content inside a Lens.
- Voice ML’s Question & Answering Service gives Lens Creators the ability to build voice enabled Lenses that can understand questions about a single topic and receive real time answers based on pre-loaded informational text.
- A new hand tracking solution has been implemented that now enables Two Hand Tracking within Lenses. This update expands upon the current 3D Hand Tracking solution to efficiently track two hands at once when building content for Spectacles.
- Lens Creators can now use the new Face Occlusion custom component that can be used to improve Face enabled Lenses by masking out content that is covered by hair, hands or other objects.
Improvements
- The Speech Recognition Template has been updated to showcase support for French.
- The Bitmoji Custom Component has been updated to include the new hand tracking solution, allowing for Snapchatters to attach their Bitmoji avatars to bodies in Lenses and enable hand tracking.
- Support for Arrays of Combo Boxes and Quaternions have been added to the Script Editor.
- Render Layer Controls now visible in the Inspector for all SceneObjects.
- Added submission warning box for Lens submissions with one camera turned off, to help creators get maximum reach on Snapchat.
- Added object preset for empty ScreenTransform.
Fixed
- Fixed issue when Auto-updater is stuck on restart if permissions to the app folder are not granted to the effective user.
- Fixed issue when parameters before the light loop node are not displayed in the material inspector.
- Fixed issue when Interactive Preview movement keys conflict with the common shortcuts.
- Fixed issue when Live tracking UI missing if you close Preview panel or open other project.
- Fixed issue with when renaming with pressing Enter can't be finished with pressing Enter second time.
- Fixed issue when script graphs cannot be exported.
- Fixed issue when @typename field doesn't refresh inspector
4.25.1
Released July 21st, 2022
Fixed
- Fixed issue with My Lenses re-login after Lens Studio launch.
- Fixed issue when VFX blend mode is not applied right away.
Improvements
- Update for Upper Garment Segmentation Model.
4.25
Released July 13th, 2022
New
- Similar to Hand Segmentation, Footwear Segmentation allows Lens Creators to segment effects within or around a user’s feet. In our Footwear Segmentation template, you will learn how to utilize the new segmentation feature to render unique effects.
- The Body Morph template enables Lens Creators to morph the body of a user into another custom mesh which has the same UV map as the standard Body Mesh.
- Lens Studio scripting now supports Script Modules in the Common JS format. By adopting this industry standard, and providing support for it in lenses, we are enabling professional JS development.
- There is now a dedicated Script Modules category in the Asset Library.
- Support for .glTF Physically Based Rendering extensions have been added, including transmission, clear coat and unlit extensions.
Improvements
- Custom Components have received the following improvements:
- Creating ScreenTransforms at runtime will now have the same default values as creating them in Lens Studio.
- Creating Visuals like Text or Image at runtime will now have automatic render order like creating them in Lens Studio.
- Added ability to view and edit common parameters in inspector for multiple selected resources of different types.
- We have updated our ASL Template with new animations, models and logic.
Fixed
- Fixed issue when VFX material can not be compiled after import from lso
- Fixed issue with colocated landmarks materials in Connected Template.
- Fixed issue with render when Face Inset was duplicated.
- Fixed Lens Studio crash when occluder material was re-added.
- Fixed issue with Uber PBR material if Blend Mode was updated.
- Fixed issue when overlay does not work because of Blend Mode from Post Effect.
4.22.1
Released June 27th, 2022
Fixed
- Fixed issue with graph material blendmode
- Fixed issue with node disconnect in graph material
- Fixed issue when colored material looks flat white
4.22
Released June 8th, 2022
New
- With the new 3D Bitmoji integration into Lens Studio, developers will be able to create new innovative ways to bring the power of expression to their avatars. Starting with 4.22, users will be able to drive 3D Bitmoji with Body Tracking.
- Please visit the Bitmoji Template to see how you can get started adding Bitmoji content to your creations.
- The Code Node is an advanced feature that enables developers the ability to create custom shader code directly in the Material Editor and VFX Editor, unlocking new effects and performance enhancements.
- A Code Node Template has been provided to showcase some beginner, intermediate and advanced shader content that is now possible in Lens Studio
- Included with this release is a dedicated Code Node Reference guide covering the syntax used by the Code Node feature.
- Shadertoy to Lens Studio is a new guide aiming to help developers migrate their shaders and materials over to Lens Studio.
- Voice ML now provides an Automatic Voice Style Selector that allows developers to automatically detect emotions from text. With this feature, developers can create a voice that corresponds to one of five emotional categorizations.
Improvements
- New assets have been included in the Asset Library to enable developers to quickly add Connected Lenses, Persistent Storage, New Face Styles and Utility functions to your creations.
- Applying prefabs sometimes caused unnecessary reordering & re-selection of prefab root's immediate children, which created confusion, and has been addressed.
- Updated the project optimization settings to remove unused render layers and lights.
- Adjusted how a new face effect is attached to a camera in the scene.
- Added a way to Sync the editor scene view with direction with map location icon for City Landmarkers.
- Improve the navigation of city scale landmarkers in Lens Studio
- Allow developers to adjust the camera speed in editor scene and interactive preview.
- You can now test shopping Lenses on push to device.
Fixed
- Fixed crash of Lens Studio on Import of different glb and glTF files with embedded texture
- Fixed crash of Lens Studio on update of some custom components
- Fixed Screen Transform position settings
- Fixed skeletal detection in preview scene
4.19
Released April 28th, 2022
New
- Lens Cloud is a collection of backend services, built on the same infrastructure that powers Snapchat. Lens Cloud vastly expands what developers can build in augmented reality by providing Multi-User Services, Location Services, and Storage Services.
- With the release of Lens Cloud, a City Scale Template has been provided to learn how to get started building city wide content for London, UK.
- A dedicated Visual Studio Code Extension has been released to give developers the functionality to use VSCode as an IDE for their Lens Studio projects. With the extension installed, VSCode enables; Code editing and smart code completion, JavaScript debugging for Lenses and JavaScript code snippets for Lens development.
- Body Depth & Normal Texture Guide and Template provides developers a detailed estimate of the depth and normal direction for every pixel of a person including their body, head, hair, and clothes. This lets the user easily create sophisticated lighting effects and calculate realistic occlusion and collisions with AR objects.
- Depth Render Target gives developers the ability to capture a Camera's depth stencil texture, enabling ways to create custom effects such as screen space normals, custom occlusions, fog, and depth-based particle collisions.
- SnapML has also received some updated features to enhance a user’s experience and understand the user’s environment.
- Light Estimation allows developers to do more realistic rendering by matching the real world lighting on objects rendered by the Lens.
- Noise/Blur Estimation gives developers the ability to match the noise and blur levels from the device’s camera with the AR content.
- SnapML now supports quantized models, an ML model format. Some of the benefits include; model size reduction by 50%, fast inference speed, and more power efficiency.
- To help showcase quantized models, a new Multi Class Classification Template has been added to showcase these new features.
- Lower Garment Segmentation has been added to the Segmentation System allowing developers to get segmentation masks based on data for upper-garment and lower-garment systems simultaneously with low overhead. A Segmentation Trails Template has been added to showcase this functionality.
- True Size Object Template is a new template that utilizes the best tracking solution available for your device to provide users an accurate scale when placing objects in their physical space. This allows users to test how well physical objects can fit into their environment.
- Voice ML has received two new templates for developers to learn how to add an extra layer of personalization to their content.
- 2D Animated Text-to-speech uses a user’s voice to animate 2D lips to be synced with voice.
- Sentiment Analyzer is a new ML model that returns one of 28 optional emotion classes, such as hope, happiness and anticipation.
Improvements
- The API Library has expanded allowing you to now build Lenses with third party APIs that give play by play data from five different sport leagues, daily zodiac astrological predictions, and location specific air quality data.
- Additionally, we made it easier to build Lenses with third party APIs by automatically generating a block of code used to connect to an API upon importing the API asset into your project.
Fixed
- Fixed issue when duplicate custom components cannot be created from script.
- Fixed issue when base color textures are tinted blue on import of certain glTF files.
- Fixed crash of Lens Studio with different glTF models.
- Fixed crash of Lens Studio when specific script has errors.
- Fixed issue when 'Device Camera Texture' moved from folder into root of Resources Panel.
4.16.1
Released March 28, 2022
Improvements
- Documentation for Plume Labs by AccuWeather APIs endpoints has been added
Fixed
- Fixed a bug that may prevent Lens Studio from starting up.
- Addressed an issue that would cause Lens Studio to crash when closing a project.
- Fixed an issue with ScriptComponents that would potentially prevent projects from opening.
4.16
Released March 16, 2022
New
- Custom Landmarkers enables Lens Creators to create their own location based AR Lenses. With this update to the Landmarker feature, Creators can utilize the new Custom Landmarker Creator lens on their LIDAR-enabled phone to scan and upload their own Landmarkers for use within Lens Studio.
- With the new Custom Components category in the Asset Library, Creators can now use script components bundled with resources that can be installed easily and added to Lens Studio projects. To celebrate the release of Custom Components, various Face Effects have been released as a Custom Component to let Lens Creator quickly utilize and implement unique face filters powered by SnapML. Popular filters such as baby, bald, anime, 3D animated and poster are now available as a custom component. Try adding them in your own project, or by checking out the Custom Components template
- Audio Classification is a new Voice ML Template that allows Lens Creators to enable Lenses the ability to listen and categorize sounds into several categories;
- Human Sounds
- Animal Sounds
- Music Sounds
- Natural Sounds
- Other Sounds (Such as - Street Cars, Work Tools)
- With the new Spectacles Voice Control template, Lens Creators can learn how to incorporate transcription and keyword detection to their wearable experience.
- Native Keyboard support has been introduced as a way to allow Lens users the ability to edit Text and Text3D components in real-time within a Lens.
- The Physics system has been updated to better support smaller objects, fast moving objects, and objects that vibrate in place. As a part of this update, Physics Matters allow for Lens Creator to adjust the bounciness, and friction settings of a given object.To help demonstrate some of these features, a Physics Toybox template has been included with 4.16.
- Snap is introducing Draco Compression integration into Lens Studio to allow Lens Creators to streamline their process when working with high-poly count and photogrammetry created 3D assets.
- Auto-Updater in Lens Studio enables users to download and install the latest version from within the application. Along with this, the feature also provides the ability to open older projects in their respective Studio builds, without the need to bump the minimum client versions for the project.
Improvements
- Various VoiceML Enhancements have been added in 4.16.
- Speech Recognition template now supports Spanish and German
- Voice UI Template now includes 2 new voice commands: “Save to Favorites” ; “Send Lens to Friends”
- In order to help streamline authentication across multiple platforms, Creators will now be able to log in via their Snapchat account when using Lens Studio.
- Physics - Static colliders can now be nested without being merged into compound shapes. This makes it so child colliders can be moved and deformed kinematically.
Fixed
- Fixed issue with VFX assets disappearing.
- Fixed compiler errors on VFX Collision template.
- Fixed problem with saving project after importing resource.
4.13
Released 2022-01-26
New
- Installable Content enables dynamic delivery of different types of content, such as templates, presets, etc. that are independent from Lens Studio versions.
- Audio Output template generates sounds with JavaScript and plays them on device. It provides simple examples such as oscillators, noise generators, audio track file players, etc.
- Downloadable Shopping Template to create Lenses connected to the Product Catalog for Snapchat Business Accounts.
Improvements
- Cloth Simulation that was only available through JavaScript, now has UI enabled.
- Foot tracking template that allows you to attach objects to your feet has been updated, and is now available in Lens Studio.
Fixed
- Fixed error if authentication scope was incorrect.
- Fixed crash on Mac with Apple Silicon CPU when trying to import HDR with high quality.
- Fixed issues with Lens Studio locking up on Windows when two or more videos textures were running.
- Fixed issue with GIF relink on losing connection to original file.
4.10
Released 2021-12-07
New
-
Sounds is an integration of a sound library in Lens Studio that enables discovery and import of licensed music tracks in Lenses. See an example in the Music Video template.
-
Physics in Lens Studio enables you to dynamically simulate real-world physics effects in your projects. Objects in the scene can now behave and interact with forces such as gravity, velocity, acceleration, and more. See it in action in the Physics template and in the updated Behavior helper script.
-
API Library The Lens Studio Asset Library now includes 3rd party APIs which can be used in lenses by Lens developers. See the Translation, Weather, and Stock Market templates for examples.
-
World Mesh provides a 3D mesh reconstruction and depth texture of the real world for recent devices (even without LiDAR). Check out the various templates to see how you can populate the world semantically, do VFX collisions with the world, as well as make depth enabled shader effects.
Improvements
- Enhancements to the VoiceML Text-To-Speech module which now includes 5 new female voice styles, a new male voice, and configurable playback speed. Check out the updated Text to Speech template to try it out.
- Audio Analyzer template has been updated to work with any audio track (try it with the new licensed audio sound library!), microphone, or even an array of raw audio samples. Additionally, the template now includes examples of driving material and VFX assets with audio data.
- VFX Collision template has been updated with an example of colliding VFX particles with 3D meshes through a depth buffer.
- New triggers and responses have been added to Behavior, including support for physics and 3D Text.
Fixed
- Fixed Eye material in Face Morph template.
- Fixed Lens Studio crash when disconnecting Spectacles 2021 from laptop.
- Fixed different results in shader when using clamp and floor nodes.
- Fixed position resets after duplication of mesh with pin-to-mesh.
4.7.2
Released 2021-11-16
Fixed
- Fixed problem with resetting of camera layer for prefabs.
- Fixed crash with using image texture in Camera’s render target.
4.7.1
Released 2021-11-08
Fixed
- Fixed problem with missing textures on certain imported assets.
4.7
Released 2021-11-01
New
- SDF (Signed Distance Field) generator: Allows creators to generate a 3D signed distance field texture from any 3D mesh. This is a powerful data format that opens the door to advanced techniques for fast, accurate collisions and to volumetric effects. See the example in the VFX Collision guide for more information.
- Media Picker: Allows creators to use an image or video from their device's camera roll as a texture. This is an enhancement to Image Picker, and Face Image Picker. See the Green Screen template to see it in action.
- 3D Text: Generate 3D meshes from text easily using the Text3D Component. See the 3D Text template for examples.
- 3D Hand VFX Template: A template that combines the using of 3D Hand and VFX effect.
Improvements
- Primitive collider shape type is available in the Collider component. It now supports primitive shapes with non-uniform scale.
- New cloth simulation examples for body tracking and primitive collider in Cloth Simulation Template.
- Preview video now supports audio for VoiceML and AudioML.
Fixed
- Various bug fixes and performance improvements.
4.4.1
Released 2021-09-24
New
- ASL Fingerspelling template which uses SnapML to detect hand signs.
Fixed
- Fixed crash related to object selection in the 2D scene panel.
4.4
Released 2021-09-15
We jumped from Lens Studio 4.1 to Lens Studio 4.4 because we are internally organizing our build & versioning system. Rest assured that you are not missing out on any functionality - this is purely a new naming convention!
New
- VoiceML: Trigger AR effects and command the Snapchat camera with your spoken words or convert text-driven Lenses to speech with new VoiceML modules:
- Speech and Command Recognition Module: Transcribe text or define specific keywords that trigger AR effects. This feature has two templates: **Speech Recognition Template and **Voice UI Template
- Text-To-Speech (TTS) Module: Convert text to automated oral speech. This feature has a **Text To Speech Template
- System Voice Commands: Enable In-Lens Voice Commands in Snapchat's Camera Tab such as "Take a Snap" or "Record a Video". Check out the helper in the Asset Library to add this function to your Lens.
- 3D Hand Tracking - Trigger and attach AR effects to hand movements in 3D space. This feature has two templates:
- 3D Hand Tracking Template: to track 3D hand model to match your left and right hand
- 3D Hand Interactions Template: to track 3D hand and create custom interactions
- External Body Mesh: Automatically attach and deform 3D custom meshes with the body pose and shape. This feature has the Try On Template which allows you to create a set of outfits that automatically deform to any body without a rig.
- 3D Skeleton Display: View and manipulate joints of imported rigged meshes within Lens Studio.
- Upper Body Skin Segmentation: Mask the skin on one’s upper body excluding their clothing and hair. This feature comes with Portrait Skin Segmentation Template.
- Connected Lenses Development Tools: Invite other Snapchatters to join a Connected Lens session in development by pushing the unsubmitted Lens to their paired account.
Improvements
- Improved search when adding nodes in VFX graph, Material graph, and visual scripting.
- Ability to sort templates by name and complexity.
- Auto-matching of 3D Body and 3D Hand model joints based on hierarchy.
- Interactive Environment supports Depth Texture.
Fixed
- Various bug fixes and performance improvements.
4.1.1
Released 2021-08-12
Improvements
- Various bug fixes and performance improvements.
4.1
Released 2021-07-20
New
- Installer size reduced from 1.7GB to 600MB, which will lead to faster downloads of Lens Studio.
- Templates are no longer installed, but will need to be downloaded on-demand.
- Lens Size Limit Increase: Increases the Lens size limits from 4MB to 8MB.
- Lens Text Localization: Allows creators to add their own localized text assets to Lens Studio from a JSON file.
- Upper Garment Segmentation: Enables multi-person garment segmentation from garments like shirts, vests, coats, hoodies and dresses.
- Multi-Object Detection: Detect where in the camera certain objects are, and add effects to them.
- Order Independent Transparency: Enables rendering of more complex objects with semi-transparency.
- Scan updates, such as triggers, templates & markers. This will enable 2D bounding box detection of things such as cup, car, dog, cat, bottle, etc.
- Remote Lens push for Spectacles 2021 is enabled.
Improvements
- Texture Compression now supports JPEG.
Fixed
- Various bug fixes and performance improvements.
4.0.1
Released 2021-06-10
Fixed
- Various bug fixes and performance improvements.
4.0
Released 2021-05-20
New
- Connected Lenses: Create shared experiences with Connected Lenses that allow multiple people to play, explore, build, and dream together, whether they’re in the same room or miles apart!
- **Scan. Build Lenses that react to things that are visible in the camera. Scan’s Visual Classification feature recognizes over 500 object and scene categories in the physical world.
- Multi-Body 3D Mesh: Industry-defining algorithms can reconstruct a subject’s entire body and hands as a 3D mesh. You can even capture multiple persons simultaneously to maximize your creative options.
- VFX Editor: Design stunning visual effects with the ultra-powerful VFX Editor, our brand new node-based particle simulation engine. From rain, to magical powers, to swarms of a million emojis, your imagination drives what’s possible. It’s fully optimized for desktop and mobile devices.
- SnapML Audio: Sound is power. Train a model and create sophisticated, multi-sensory experiences with audio-activated Lenses. SnapML Audio can identify and react to human speech, ambient noise, languages, music, and thousands of everyday sounds that you can use to trigger limitless workflows.
- Cloth Simulation: Incorporate realistic textiles into your Lens designs with 4.0 Cloth Simulation. Progressive, physics-based mapping means virtual fabrics look and move like the real thing. Experiment with innovative patterns and textures or stick to the basics.
- Hair Simulation: Create visionary styles with enhanced, 4.0 Hair Simulation. Customize colors, textures, length, and even simulate wind with realistic modeling that replicates hair physics and accounts for various face shapes. For added versatility, import customized styles from partner design programs.
- Integration with Spectacles (2021): Design, build and deploy immersive experiences for Spectacles (2021).
Improvements
- Dynamic Environment Maps: Bring more realism to your creations by projecting the real world onto a virtual one.
- Spatial Audio and Mix To Snap: Create immersive audio experiences for Snapchat and Spectacles (2021) and let your audience enjoy higher quality audio in their Snaps.
Fixed
- Various bug fixes and performance improvements.
Legacy Release Notes
3.4.2
Released 2021-04-06
Fixed
- Various bug fixes and performance improvements.
3.4.1
Released 2021-03-25
Fixed
- Various bug fixes and performance improvements.
3.4
Released 2021-02-25
Improvements
- Device Simulation updated to the most recent Snapchat UI.
- Interactive Preview in Preview Panel improvements - movement to specific location of a scene, locking Y coordinate of position.
- Added the option to overwrite initial project file during project updates
- SnapML now supports TensorFlow Lite float/quantized models.
- SnapML now supports new Layers - Embedding, RNN, BatchMatMul.
- ONNX/TF import – various improvements, learn more in the ML Compatibility table.
- Depth data from the iOS LiDAR scanner is applied to Depth Texture, including Depth Enabled Templates
- Material Editor improvements as ability to allow using the Bool Parameter node with other relational nodes (such as equal, greater than, etc.) while maintaining its static capabilities, unpack node precision update.
Fixed
- Various bug fixes and performance improvements.
3.3.3
Released 2021-01-14
Fixed
- Lens publishing and My Lenses bug fixes.
- Various bug fixes and performance improvements.
3.3.1
Released 2020-12-18
Fixed
- Various bug fixes and performance improvements.
3.3
Released 2020-12-08
New
- Visual Scripting – Create custom interactivity using node-based scripting, without coding.
- My Lenses 2.0 – Manage your Lenses in browsers outside the Lens Studio application.
- Texture Compression – Pack in richer assets for more compelling Lenses with automatic tunable compression inside the app.
- Logger – Group, filter, and search messages in the logger view.
- Face Morph Template – Morph a face in 3D using a custom mesh.
- Configuration Template – Use UI widgets to create an adjustable Lens.
- Tween Template – Set up animations using a dropdown menu.
Improvements
- Compatible with Apple-silicon based Macs using Rosetta.
- Device Simulation Snapchat UI updated to the most recent one.
- Ability to reset a Lens during recording.
- SnapML performance improvements including Elu, Softplus, Softsign for Android GPUs and various CPU optimizations.
- SnapML supports new Layers – LSTM, Permute.
- ONNX/TF import – various improvements, learn more in the ML Compatibility table.
Fixed
- Fixed various issues in SnapML export from pytorch 1.7.
- 'Optimize project' no longer deletes unused ML models.
- Various bug fixes and performance improvements.
3.2
Released 2020-10-13
New
- Hand Segmentation Template – Shows you how to add an image to the hand, as well as occlude things behind the hand. In addition it demonstrates how you can use hand gestures to control the effects around the segmented hand.
- Behavior Template – Demonstrates how you can use the Behavior Helper Script to set up different effects and interactions through a dropdown menu. You can choose different triggers like face or touch interactions, and respond to them with effects like enabling objects, playing tweens, and more!
- Search for Templates and recent projects – Use the Search bar in the Home Screen to quickly find a template or recent project.
- Head Mesh – Track a user’s whole head shape including the skull.
- Post Effects – Smoothing, Gaussian Blur.
- World Mesh – A dynamic mesh object that provides semantic understanding of the environment, raycasting capabilities, occlusions and more. (Note: available for iOS devices w/ ARKit 3.5+ and a rear-facing LiDAR sensor.)
- Interactive Preview – An interactive preview mode that uses a virtual 3D scene (rather than images or videos) with controls for looking and moving around with 6 degrees of freedom.
Improvements
- Material Editor script nodes improved with ability to upgrade nodes from previous versions.
- Ability to create an animation atlas smaller than 256 pixels.
- Added support for webp image format.
- SnapML performance improvements:
- Instance Normalization layer in Android GPU (more than 100% faster)
- Nearest neighbor upscale in Android GPU
- Global Average Pooling in Android GPU
- Various CPU optimizations
- SnapML new Layers added:
- Sin
- Cos
- Argmin/Argmax
- Concat and eltwise now works with constant node
- ONNX/TF import – various improvements, learn more in the ML Compatibility table.
- Behavior Script can now trigger Lens hints, script APIs, go through a list of custom triggers, as well as check distance between screen transforms.
Fixed
- Fixed – Device Tracking Rotation doesn't work in preview.
- Fixed various issues in SnapML export from pytorch 1.6.
- Various bug fixes and performance improvements.
3.1
Released 2020-08-13
New
- Full Body Triggers Template - Use Full Body Tracking to trigger effects depending on the pose of the user, as well as when a joint hovers over a screen position. This template is great for dance related videos.
- Full Body Attachments Template - Attach objects between joints provided by Full Body Tracking. It comes with primitive objects attached between each tracking joints used to approximate an occluder for objects to go around.
- Material Editor Search - Find nodes with a new search feature.
Improvements
- Export multiple objects to .lso format.
- Start and stop particle generation using corresponding API methods available. Take a look at the Particles Template to learn more.
- Replace one resource with another all over the scene for meshes, materials and sounds.
- Hide/show the grid in the 3D Scene.
- Updated face images/videos to a new wide format (much larger horizontal Field of View).
- ONNX/TF import - various improvements, find out more in the ML Compatibility table.
Fixed
- Fixed flipped textures after glTF import.
- Various bug fixes and performance improvements.
3.0.1
Released 2020-07-14
Improvements
- SnapML: TensorFlow converter supports more model types.
Fixed
- Various bug fixes and stability improvements.
3.0
Released 2020-06-11
New
- **SnapML - Bring your own neural networks to Lens Studio! Train a model and import it to create never-before-seen Lens effects!
- **Style Transfer Template - Stylize the camera to look like a painting, sketch or whatever your imagination can think of!
- **Object Detection Template - Find and track arbitrary objects in the camera. The provided template tracks cars, but you can use the example notebook to train a model to detect any object!
- **Glasses Classification Template - React to a person wearing glasses. The example notebook can be used to train a model to classify other objects that you have training data for.
- **Pizza Segmentation Template - Get a custom segmentation mask and use it to apply unique visual effects. The provided model masks pizzas, but you can retrain the network to segment anything you have training data for.
- **Ground Segmentation Template - Apply visual effects that transform the world around you using the ground segmentation model.
- **Face Expressions Template - Use 3D face mesh blendshapes to animate a custom 3D character.
- **Face Landmarks Template - Leverage 2D face tracking landmarks to drive interesting visual face attachments.
- **Hand Gestures Template - Use common hand gestures like pointed index finger, thumb and the peace sign to trigger sound effects. Modify to use as triggers for your custom effects.
- 3D Eyeball Tracking - Replace or augment eyes in full 3D, including realistic gaze tracking!
Improvements
- Refreshed UI with two themes - See more information in the Object, Resource and Inspector panels with an all-new look. Includes more intuitive icons and convenient ‘Close to Home’ button.
- Dock a minimized preview in scene panel - Keep the preview panel visible without taking up as much screen space by docking it in the lower-right corner of the Scene Panel
- Script Editor - multiple UX improvements.
- Material Editor – new types of nodes were added as loops, access to light source properties, working with matrices.
- HDR Compressed Textures - option to compress environmental map textures to decrease the archive size of your Lenses.
- Screen Texture - simplified moving of effects between cameras by adding the alias of current render target.
- Mesh Precision - ability to switch vertex attribute format of any mesh.
- Materials - added extended frustum culling and instance count.
Fixed
- Fixed issue with UI getting cut-off for macOS Catalina users
- Fixed issue with UI scaling on Windows
- Fixed crash on saving invalid JavaScript
- Fixed crash on adding UI_Widgets.lso
- Fixed crash on scrolling My Lenses and expanding Lenses info
- Fixed issue with infinite loops in JavaScript blocking UI
- Various bug fixes and performance improvements
Lens Studio 3.0 requires macOS 10.13 High Sierra or newer
2.3.1
Released 2020-02-04
Improvements
- Reduced size of Lenses that use Segmentation or Object Tracking
Fixed
- Lens Studio now runs on Windows 7
- Improved stability on GeForce GPU with specific drivers for Windows
- Fixed creation/opening projects crashes on macOS 10.13 High Sierra with Radeon GPU
- Other bug fixes and performance improvements
2.3.0
Released 2019-12-12
New
- Material Editor - Build your own shaders using a powerful visual programming tool and accomplish a wide range of graphic effects!
- Material Library - With a few clicks, make any object look like wood, crystal, or even salmon! You can make them glitch, melt, or disintegrate too.
- Face Mesh - Track a user’s face shape and expression to produce a highly realistic 3D mask. Combine 3D Face Mesh with the new Material Editor to have your Lenses distort and change the user's face in 3D!
- Our Script Editor has received a big upgrade with the addition of auto-complete, error highlighting and more! Additionally, we made some changes to the scripting API to make it easier to develop Lenses.
- Face Mesh Template - Apply custom textures, reflection, and effects to a 3D face model that mimics the user’s facial interaction.
- Material Editor Template - Use advanced materials to modify how your 3D objects look.
- Chain Physics Template - Simulate the movement of chains, earrings, and more in your Lenses!
- Report an issue directly from Lens Studio application.
Fixed
- Various bug fixes and performance improvements
2.2.0
Released 2019-11-15
New
- Create Lenses for Spectacles 3 - Use the Depth Setter component to enable realistic occlusion of AR objects when applied to videos shot on Spectacles 3! Additionally, we added an API that provides you with the path traveled by the camera when the video was recorded.
- Spectacles Path Template(Deprecated) - Create a tunnel of objects based on your video's path.
- Spectacles Depth Template(Deprecated)- Send an object flying that will collide and react to surfaces in your video.
Improvements
- Improved segmentation quality
- Improved object tracking quality
Fixed
- Various bug fixes and performance improvements
2.1.0
Released 2019-08-27
New
- Skeletal Template - Skeletal tracking allows you to track content to people's head, neck, shoulders, elbows and hands. Ideal for registering content to people at a distance from the camera.
- Face In Video Template - Track a user's face onto a video. Check out the template guide to learn about getting tracking data for your videos.
- Hair Color Template - Modify your hair with simple controls. Choose between one or two colors, where the coloring is applied, and how it appears.
- Countdown Template - Create Lenses that count down to specific dates and add celebratory 3D hats and glasses.
- Portrait Particles Template - Customize particles that appear behind the user. Make it personal by adding your own custom message, headers, footers, and post-effects.
- Makeup Template - Apply lip gloss, blush, eyeshadow and more. Optionally, export your makeup to use in other Lens projects.
- New Landmarkers - New Landmarkers are popping up all over the world. Experiment with new locations like the Gateway of India and the Leaning Tower of Pisa, and check the Landmarker downloads page for the full up-to-date list.
- Redesigned Home Screen - Our new dynamic home screen shows you the most recent updates and news related to Lens Studio.
- Interactive new user tutorial - Our step-by-step tour makes creating your first Lens faster and easier than ever.
Improvements
- Improved Template page - Added categorization, template complexity level and detailed description for all templates
- Added text backgrounds and text auto-resizing
- Improved object tracking quality
- UI tweaks and improvements
Fixed
- Various bug fixes and performance improvements
2.0.1
Released 2019-04-04
New
- Pet Tracking Template - Track cat and/or dog faces to enable experiences made to order for our favorite canine and feline companions.
- Hand Tracking Template - Hand tracking opens up all new possibilities for interactive Lenses. Use as a basic trigger or anchor content to the Screen Transform provided.
- Body Tracking Template - Body tracking provides a bounding-box, ideal for registering content to people detected in the camera.
- High Score Templates - The High Score templates demonstrate playable experiences built inside Lens Studio. They use new capabilities like User Context (for displaying the user’s name) and Persistent Storage (for saving a high score with the Lens).
- Paper Head Template - Attach 2D textures to the face that animate in response to facial movements.
- Cutout Template - Add movable 2D images to the world that cast a shadow.
- Landmarker Templates (Beta) - With new Landmarker AR technology, you are able to place 2D and 3D content onto a set of real-world landmarks. The templates show you how to place 2D planes on the buildings, position 3D objects relative to the buildings and even retexture their surfaces.
- UI 2.0 Text - Text component adds support to Labels for resizing, word wrap and even dynamic strings – like the Snapchat user’s display name – with no scripting required.
- UI 2.0 Image - Image component gives you the same familiar ease-of-use as Sprite and adds powerful support for pixel-perfect 2D layouts that look great on all devices.
- UI 2.0 Screen Regions - Screen regions are like 2D containers that help you lay out Text and Images exactly as you want them to appear. Helpful presets – Safe Render, Full Screen, Capture and Preview – give you easy access to perfect Lens UI, unobstructed by Snapchat’s native UI.
- UI 2.0 Screen Transform - The underlying building block for Screen Regions, Text and Images, power users and beginners alike can create, customize and even nest Screen Transforms to unlock simple-yet-powerful relationships between UI elements in the scene hierarchy. Screen Transforms give you total control over how your UI elements scale, move and adapt to changes in the parent.
- UI 2.0 Persistent Storage - Persistent Storage lets you save data related to your Lens experience on users’ devices so they can pick up right where they left off the next time they launch your Lens. Unlock content, let users customize their experience, keep track of high scores…
- Live & Capture Render Targets - Ever wanted to put overlays on screen that you don’t want recorded in Snaps? With separated Live and Capture render targets you can show one thing and record another. You now have the power to give users the context they need while still producing beautiful Snaps that they’ll want to share. Karaoke, anyone?
- Script Behavior System - If you’re not a pro coder, or just sick of writing boilerplate JavaScript, the Script Behavior system is for you. It makes adding simple but powerful interactivity to your Lens easier than ever by providing an intuitive UI right in the inspector panel. No scripting or coding required!
- Visual Effects Library - Check out our awesome new materials, each with powerful custom controls, that let you create stunning visual effects without needing to worry about the details of a shader languages and hardware compatibility.
- User Context System - Request real-time info about the Lens user to customize on-screen text, including user name, city, altitude, time, weather, temperature, birthday and more!
- Device Simulation - Pop-out the preview panel to reveal realistic renders and screen simulations from a diverse set of devices. For sponsored Lens creators, you can toggle placeholders for the sponsored slug and call-to-action attachment button so you can avoid overlapping UI.
- Lens Previews - Creating an interesting preview so users know what your Lens is all about is critical for engagement. Choose from a library of pre-recorded videos and images and Lens Preview does the rest, applying your Lens, recording a short sample and adding it to your project info. And when you want full creative control, you can still create your own previews from scratch.
- glTF - Adding to our range of supported file types, you can now import glTF files directly into Lens Studio.
- Optimization Tools - New measurement tools and UI shows your Lens’s size right where you need it: on the toolbar. Color coding and tips provide context so you can understand the trade-off between adding that high-res texture and the potential impact on user engagement.
Improvements
- All changes in the public folder are synced with Resources panel on-the-fly
- Improved resources’ undo/redo mechanism
Fixed
- Various bug fixes and performance improvements
1.7.1
Released 2018-12-12
New
- Sunglasses Template - Create custom sunglasses! Simply tune your frame, lenses and reflection
- Logo Controller - The Logo Controller is a new helper script used for placing a logo on the screen. It includes preset logo positions, enforces screen safe areas and adds padding for Snapchat UI elements
Improvements
- Added symmetrical mode for Face Liquify
Fixed
- AudioEffect - Exported objects with the AudioEffect component now import properly
- Animated Textures - Fixed crashes related to importing textures
- Animation Mixer - Fixed crash on Undo
- Prefabs - You can now delete imported FBX/OBJ resources
- Sprites - Fixed crash on sprite duplication
- Fixed crash after applying prefab with Touch component
- Fixed visual pivot editor in the inspector of Label component
1.7
Released 2018-10-18
New
- Marker Template - Adds content tightly tracked to an image marker. Includes pre-built marker animations
- Marker with Snapcode Template - Unlock a marker experience from a Snapcode. The Snapcode will be tracked until the marker is found
- Segmentation Template - Replace a segment of the camera with an image, tiled image or post effect coloring
- Face Image Picker Template - Select a face from your camera roll and add it to an animated world object
- Label - Lets you add dynamic text to your Lens experience
- Audio Effect - Add audio effects to your Lens that are applied to the audio that the microphone recorded
- Segmentation - Segmentation textures can be applied to a camera's input to show or hide certain areas of the scene
- Marker Tracking - Adds the ability to track to a unique physical image
- Image Picker and Face Image Picker textures - Allows you to get an image from your device's camera roll and use it as a texture
- Prefabs - Create reusable Scene Objects that share common properties
- Pin to Mesh - Allows you to attach one object to another object's mesh surface
- Vertex Animation - Animate the individual vertices of an object
- Tween System - Tween system integrated into Lens Studio with new features added
Improvements
- Icon Cropper - You can now easily crop and set your icon background color inside Lens Studio
- 2D Scene, Multiple Object - You can now see and select from multiple objects in the 2D scene
- 2D Scene, Rotation - Simply mouse over a 2D elements corner to rotate the object
- 2D Scene, Snapping - Snap points for 2D tools that can be enabled / disabled
- Template Categories - On the start screen, templates are categorized
- Unified Manipulator Tool - Translate, Rotate and Scale all at the same time
- FBX Import Options - Options to configure the 3D model import
- Render Layer Visualization - Small icon in objects panel that represents object's render layer
- Object Panel Views - You can now configure your objects panel to sort by render order and by assigned render layers
- Sprite and Label Pivot - New helper buttons for assigning commonly used pivot positions
- Record Preview - Ability to record a video from the Preview panel
- Preview Videos - New preview images and videos for testing Marker experiences
- GIPHY Add as Resource - Added ability to add just the resource from GIPHY
Fixed
- Various bug fixes and performance improvements
1.6.2
Released 2018-06-19
New
- Team Celebrate Template - Create a Lens for your team! Simply tune your team's colors and logo
Improvements
- Default My Lenses window size increased
Fixed
- Scripts with invalid inputs crashed Lens Studio after preview reset
- Preview was not working for some projects
- Video rendering inside Lens Studio for macOS 10.10 and 10.11
1.6.1
Released 2018-06-01
Fixed
- Fixed issue with running on unsupported Windows versions and GPUs
- Fixed issue with adding video textures
- Fixed issue with video texture autoplay setting when saving project file
1.6.0
Released 2018-05-30
New
- Native AR tracking support. With “Use Native AR” enabled in Surface tracking mode, tracking will be enhanced on compatible devices using the device’s native AR tracking capabilities, such as ARKit and ARCore. Tracking will fallback to Surface for all other devices
- Camera gizmos in the Scene panel change depending on tracking mode
- New World Template: Portal
- New Face Template: Face in Picture
- Automatic resize of Lens icon when it’s added in Project Info dialog
- Validation of unsupported audio formats
- Several new device aspect ratios for Webcam Preview
- Validation of system requirements before Lens Studio starts. The app will show a warning if the system requirements aren’t met.
Improvements
- More precise Lens size calculation
Fixed
- Stability fixes for Undo
- Lens is submitted as new after Save As
- My Lenses window resizability fix
- Various Windows stability fixes
- Various bug fixes and performance improvements
1.5.1
Released 2018-04-30
Improvements
- Optimization of disk space usage
Fixed
- Various stability improvements on Windows
- Fixed crash in optimization dialog for disabled objects
1.5
Released 2018-04-17
Introducing Face Lenses in Lens Studio!
New
- Face Lenses with a collection of Face Templates: Photo, Face Paint, Distort, 2D Objects, 3D Objects, Baseball Cap and Trigger
- New Face effects: Face Mask, Face Stretch, Face Sprite, Face Liquify, Face Retouch, Face Binding, Heading Binding and Face Texture
- New World Templates: Particles and Interactive Path
- Smart Scene Toggle: Switches between 2D Scene and 3D Scene automatically based on object selected
- Particles: A new object type that allows you to create and tune particles
- Add From GIPHY: Add new Face Sprites, World Sprites and Billboards using animated resources from Giphy Stickers
- GIF import: Drag and drop a GIF into the Resources panel to create an animated texture
- Animation Mixer: You are now able to create animation clips and auto play the animation
- Global Lighting: Environment map is stored globally on an Ambient Light object. Shadow density can be tuned globally as well on a Directional Light object
- Post Effect Presets: Added a number of Post Effect textures in the Resources Panel for easy full screen coloring
- Webcam Preview: Added the ability to preview your Lens using your computer's webcam
- Preview: New preview images and videos for face
- Tracking: Added scriptable support for setting a surface tracking target for better tracking performance
- Copy / Paste Component: Components and their settings can now be copy and pasted
- Find Usage: Right click the Resources panel to find the usage of a resource in the scene
- Camera Select: Ability to select which camera the Lens will appear on in Project Info
- Hints: New hints for face support and scriptable hints
- Updates: Automatic Check for Updates
- Resources: Added 'Show in Finder/Explorer...' right click option
Improvements
- Layout: Improved default layout which includes a larger Inspector panel
- Add Object / Component / Resource / Preview Selection UI: The new selection prompt is searchable and elements can easily be favorited
- 2D Scene UI: Various helper buttons and tunable settings moved to the button of the 2D Scene panel
- Template Selection: Categorized by Face and World. Added links to each template's tutorial video and documentation
- 2D Animation: Improved default settings for 2D animation importing for better resource optimization
Fixed
- Various FBX import issues
- Frame tool selection issues
- Reset tracking after changing preview video
- Zoom for orthographic camera
- Various bug fixes and performance improvements
1.0.1 (Win) & 1.0.2 (Mac)
Released 2018-03-02
- 1.0.2 update fixes an issue with Mac OS X 10.10 Yosemite.
- 1.0.1 includes a Fullscreen Template that makes it even easier to create 2D experiences, as well as bug fixes for improved stability.
New
- Check out the new Fullscreen Template!
Improvements
- FBX export from popular libraries including Mixamo
- Added ability to multiselect the whole hierarchy in order to assign materials
- Overall stability and performance
Fixed
- Mac OS X 10.10 Yosemite issue
- Non-Latin characters in username and folders no longer cause instability on Windows
- Fixed issues relating to duplicating top-level and empty objects
- Improved handling of loss of Internet connection
- 2D screen mode Snapchat UI layout adjustments
- Restore volume on unmute
1.0.1
Released 2018-02-05
This update includes a Fullscreen Template that makes it even easier to create 2D experiences, as well as bug fixes for improved stability.
New
- Check out the new Fullscreen Template!
Improvements
- FBX export from popular libraries including Mixamo
- Added ability to multiselect the whole hierarchy in order to assign materials
- Overall stability and performance
Fixed
- Non-Latin characters in username and folders no longer cause instability on Windows
- Fixed issues relating to duplicating top-level and empty objects
- Improved handling of loss of Internet connection
- 2D screen mode Snapchat UI layout adjustments
- Restore volume on unmute