Category Archives: mixed reality

Auto Added by WPeMatico

Windows 10 Tip: View 360° videos and photos in Microsoft Edge with your Windows Mixed Reality headset

With the 360 Viewer extension and a Windows Mixed Reality headset plugged into your PC, you can view 360° videos and photos in your headset from Microsoft Edge, simply by clicking the Windows Mixed Reality icon that has been added to the video or photo.
You can also navigate to a website in Microsoft Edge on your desktop, play a 360° video and click on the Mixed Reality icon. This will automatically launch Windows Mixed Reality and start playing the 360° video in your headset, as long as you have your headset plugged into your PC.
Once you’ve downloaded this extension, you can browse and see 360° photos, watch 360° YouTube videos of a shark encounter or enjoy 360° videos from the NYTimes website – all in your Windows Mixed Reality headset from Microsoft Edge.
To learn more about Windows Mixed Reality, head over here!
*Currently supports content from YouTube, Facebook, Twitter, and NYTimes. Requires a Windows Mixed Reality immersive headset and compatible PC.

How mixed reality is changing the game for healthcare, from performing live surgeries to delivering ultrasounds in 3D

Last year around this time I had the chance to write a post about one of my favorite mixed reality uses cases – healthcare.
Since that time, we have continued to see remarkable momentum for mixed reality across numerous facets of the industry. This week at HIMSS our team had the privilege to once again be on the ground to see and experience how customers and partners are embracing mixed reality to transform the way they innovate, support, and help others.
Coming out of the show I wanted to take a moment to spotlight some of the innovation work we are seeing from organizations who are working to forge the future of healthcare.
CAE Healthcare
Joining us onsite at HIMSS this year was CAE Healthcare. CAE is an industry leader in the development of simulation-based technologies, curriculum, and resources that improve clinical performance. I talked about some of their earliest work with Microsoft HoloLens last year – well, they certainly haven’t slowed down!
CAE VimedixAR is the first ultrasound simulator to integrate HoloLens. Freed from the limits of a two-dimensional environment inside a monitor, healthcare professionals can display, enlarge, turn, and rotate realistic-looking anatomical parts, or command them to return into the manikin body. Users and those learning with this technology are able to witness (in real time) the ultrasound beam as it cuts through human anatomy.

With CAE LucinaAR, clinical learners can view 3D holograms of a fetus as it descends the birth canal and gain an unprecedented view of anatomy as they learn to manage a shoulder dystocia delivery. CAE Lucina is a wireless childbirth simulator with validated, integrated maternal-fetal physiology for training on all the stages of delivery and the rare emergency scenario. With five pre-configured Simulated Clinical Experiences (SCEs), and new mixed reality modules coming soon, Lucina allows instructors at universities and hospitals to easily integrate simulation and augmented reality into their hands-on educational programs.

With their Abiomed Impella procedural training solution, CAE Healthcare is integrating HoloLens into its simulation-based training platform that allows physicians to practice ultrasound-guided placement of the world’s smallest heart pump. Overlaying the ultrasound manikin, probe and instruments, the CAE HoloLens framework will depict physiological responses and potential complications to help clinicians quickly master and deploy the device without risk to patients.
Adding to its physics-driven simulator for the Medtronic Micra Transcatheter Pacing System (TPS), the world’s smallest pacemaker, CAE Healthcare delivered a mixed reality training solution for up to 11 simultaneous learners on its Microsoft HoloLens platform. Learners can practice while viewing interactive holograms of a 3D beating heart into which the Micra delivery system is visible and connected in real-time.
Pearson delivers mixed reality learning tools for nursing professionals
At Bett this year we were thrilled to announce some of the great curricula our friends at Pearson were delivering to train nurses using mixed reality and the benefit of holographic patients. Today, I am happy to share more details about one of their extraordinary pieces of the curriculum – HoloPatient.
HoloPatient is a mixed-reality learning tool for nursing, allied health and medical schools that will deliver simulated patient experiences to more students, at a more manageable cost, and with a greater degree of consistency than ever before. This cutting-edge 3D immersive solution redefines how learners interact with their worlds and each other—bringing learning to life with startling clarity and breathing new possibility into teaching. Designed and conceived in collaboration with expert healthcare educators and simulation facilitators from around the world, HoloPatient uses Microsoft’s Mixed Reality Capture technology allowing tutors and students to engage in a range of learning and assessment activities previously only possible when using actors or by encountering patients in real life.

HoloPatient drives consistency across the delivery of learning content and assessment while also allowing nursing and medical schools to augment their existing delivery of world-class education and training with one of the most promising and engaging teaching and learning use-cases for mixed reality currently available.
The HoloPatient app will be released globally in April 2018, along with a virtual reality version later in the year. By the end of June 2018, Pearson will have released four other learning tools including Anatomy, Chemistry (building molecules in 3D), Math (Area and Volume of 3D objects) and History.
You can find out more at
SphereGen is utilizing mixed reality to create innovative solutions designed to increase efficiency and revolutionize the learning process. SphereGen collaborated with St. George’s University to develop the Learning Heart. The Learning Heart is a HoloLens application that assists students in understanding the elements of the Heart. As a study aid and teaching tool, this application can be used individually or collaboratively by multiple HoloLens users. The holograms are fully three-dimensional and can be traversed around and viewed from any position and angle.

DICOM Director is a full product suite designed to enable communication and collaboration between different radiologists, doctors, and medical practices. The backend of this solution enables radiologists to view, transfer and share scans. This solution utilizes HoloLens as a viewer for radiological scans, such as MRIs, cat scans, and several others. Radiologists and doctors can remotely view their scans through the HoloLens and/or a Windows Mixed Reality headset. The viewing functionality enables the user to see the series of scans, an enlarged view of the selected scan (which they can scroll through), and the 3D model reconstruction from the scans.

Live surgery with HoloLens
One of the most mind-blowing moments in mixed reality occurred just a few months ago. On that day AP-HP, Paris French hospitals group, conducted a live surgery on YouTube, assisted by TeraRecon medical holographic platform leveraging Azure GPU and HoloLens. The surgeon was assisted by TeraRecon and their partners to develop the complete end-to-end solution from the patient surgery planning up to the real-time streaming of the real patent image data (pre-operative 3D CT scan) with its full volume rendering in the highest quality ever seen including segmentation of the CT scan. This live surgery was conduct using sharing experience to share the same patient data across multiple HoloLens with the same holographic space (operating room) as well as sharing the HoloLens view with the remote surgeon.
With a mission to empower doctors, Visual 3D Medical Science and Technology Development CO. LLC) is dedicated to the use of artificial intelligence, cloud computing, and mixed reality to enhance the capability of doctors. By way of research and development, Visual3D’s technology can promote doctor’s ability of perception and appliance of medical information; enhance the remote cooperative abilities of doctors in different places to build a scientific and technological platform for intelligent medical therapy.
Visual3D has already performed over 200 hip, knee, and spinal surgeries in China using HoloLens. In addition to using HoloLens in the operating theater, Visual3D is using HoloLens to assist doctors pre-surgery as both a tool to brief patients on their upcoming surgical procedures, as well as allowing doctors to pre-visualize and rehearse the procedure before entering the operating room.
Next Surgeries
Digital Pages, a leading Brazilian company in the lifecycle management of digital contents, has developed an interactive application for surgery planning using Microsoft HoloLens. The application offers students, surgeons and healthcare professionals a new perspective on the modeling and manipulation of physical and virtual 3D objects. Next Surgeries introduces the use of holographic projections in surgical planning, reducing the total time of surgeries, the exposure of the patient and staff to radiation and risk of infections, blood loss, etc. The application is available on the digital teaching platform RDP Learning integrated to HoloLens, bringing innovation and more security to the health sector.
I look forward to sharing more with you all soon as we continue to shine a light on many of the great mixed reality innovations being delivered by customers, partners, and developers of mixed reality!

#ifdef WINDOWS – How to enable WebVR with just two lines of code with BabylonJS

BabylonJS is a very powerful JavaScript framework for building 3D apps and games with web standards, used by game developers to build some amazing experiences that can run on any platform and device. This includes Windows Mixed Reality and VR platforms such as Oculus or SteamVR.  
With the latest release of BabylonJS, developers can enable immersive experiences with only 2 lines of code. David Rousset, one of the core authors of BabylonJS, stopped by to show just how easy it is to create fully interactive WebVR apps. Watch the full video above and feel free to reach out on Twitter or in the comments below for questions or comments. 
Happy coding! 

Mixed Reality at Microsoft – February update

It’s hard to believe that 2018 is almost two months old! Speaking on behalf of everyone on the mixed reality team at Microsoft, we are excited about the year to come. We have a lot of fun things planned.
Because I love mixed reality so much, I thought February 14th (Valentine’s Day for those who celebrate) would be the perfect day to kick off a new regular update from us. Each month we will share some news on what we are doing, and we will highlight some of the great work coming to market from our customers and partners.
Let’s get going with what we have to share today!
Making it easier to get your hands on HoloLens
We have heard loud and clear that people are looking for additional ways to get HoloLens. To support that demand we have two important program updates to share.
HoloLens expands to more markets
First, I’m happy to announce we will soon be making HoloLens available in Singapore and the United Arab Emirates. To all the developers, creators, partners, and customers we will now work with – welcome! With these new additions, HoloLens is now available in 41 markets around the world.
HoloLens now available for rent
Second, many of our customers have expressed a desire to rent HoloLens, so that companies can evaluate before purchasing or increase their inventory temporarily to support tradeshows and events.
Today, we are excited to help remove this barrier and announce that customers in North America can now rent a HoloLens from our partners at ABCOMRENTS. We are also working to bring this program to additional markets in the months ahead. We look forward to sharing those details soon.
For those in the USA and Canada who are interested in renting HoloLens devices, please visit this link.
Continued adoption of mixed reality
The best part of my job is seeing what people around the world are doing with mixed reality. The innovation and development we see on the platform inspires us to create the software and tools needed to bring the potential of mixed reality to life.
Over the first six weeks of 2018, we have seen some really great work from our partners and customers. Here are a few of my favorites.
Trimble expands their mixed reality product portfolio

Last month, Trimble announced Trimble Connect for HoloLens and a new hard hat solution for HoloLens that improves the utility of mixed reality for practical field applications. Trimble has paid close attention to how to support HoloLens as a high-value tool for firstline workers and are continuing to increase their impact on the market.
Trimble Connect for HoloLens is a mixed-reality solution that improves coordination by combining models from multiple stakeholders such as structural, mechanical and electrical trade partners. The solution provides for precise alignment of holographic data on a 1:1 scale on the job site, to review models in the context of the physical environment. Trimble Connect for HoloLens is available now through the Microsoft Store.
Trimble’s Hard Hat Solution for Microsoft HoloLens extends the benefits of HoloLens mixed reality into areas where increased safety requirements are mandated, such as construction sites, offshore facilities, and mining projects. The solution, which is ANSI-approved, integrates the HoloLens holographic computer with an industry-standard hard hat. Trimble’s Hard Hat Solution for HoloLens is expected to be available in the first quarter of 2018.
HP unveils Windows Mixed Reality Headset – Professional Edition
Last week, we saw HP announce the HP Windows Mixed Reality Headset – Professional Edition. What we love about this headset is the work HP is doing to enhance the way work is done within a set of industries we also care deeply about – Engineering Product Dev and design reviews, AEC (Architecture, Engineering & Construction) reviews, and MRO (Maintenance, Repair and Overhaul) training use environments.

Just like the consumer edition, this headset delivers 1440×1440 resolution per eye and up to a 90Hz refresh rate. For businesses, this headset is the perfect combination of comfort and convenience as it comes with easy to clean, replaceable face cushions. It also uses a double-padded headband, easy adjustment knob and front-hinged display for a superb experience for one or more users.
Honeywell introduces mixed reality simulator to train industrial workforce and help close skills gap

Earlier this week Honeywell Process Solutions announced a cloud-based simulation tool named Honeywell Connected Plant Skills Insight Immersive Competency. This new offering uses mixed reality to train plant personnel on critical work activities. With as much as 50 percent of industrial plant personnel due to retire within the next five years, Immersive Competency is designed to bring new industrial workers up–to–speed quickly by enhancing training and delivering it in new and contemporary ways. By implementing experiences that take advantage of both HoloLens and Windows Mixed Reality immersive headsets, Honeywell has been able to deploy a solution that directly links industrial staff competency to plant performance by measuring the training’s effectiveness based on real outcomes.
We look forward to sharing more next month. If you have any questions or needs, feel free to reach out to me on Twitter – @lorrainebardeen.
And – if you celebrate – enjoy Valentine’s Day! Here’s a little something for you.


Mixed Reality at Microsoft – February update
Tweet This

#ifdef WINDOWS – 3D launchers and glTF toolkit

With the Windows 10 Fall Creators Update, when developing experiences for Windows Mixed Reality, a 3D launcher can be defined to override the default 2D launcher and provide a richer experience launching a game or app from the mixed reality home.
Roberto Sonnino and Tom Mignone from the mixed reality team dropped by my office to give me a hands on demonstration as we discussed why developers should consider creating 3D launchers and what is possible when creating 3D tiles. We also covered why the team chose glTF as the file format and how they created the glTF toolkit to make it very easy for developers to modify and optimize glTF assets.
Check out the full video above and feel free to reach out on  Twitter or in the comments below.
Happy coding!

#ifdef WINDOWS – Getting Started with Mixed Reality

I sat down with Vlad Kolesnikov from the PAX Mixed Reality team in Windows to talk about what mixed reality is and how developers can get started building immersive experiences. Vlad covered what hardware and tools are needed, building world-scale experiences, and using the Mixed Reality Toolkit to accelerate development for Microsoft HoloLens and Windows Mixed Reality Headsets.
Check out the video above for the full overview and feel free to reach out on Twitter or in the comments below.
Happy coding!

Microsoft Announces Simplygon Cloud; Optimizes Mixed Reality Development

Earlier this year, we announced the acquisition of Simplygon, a leader in 3D model optimization based in southern Sweden. As we continue our journey to bring the benefits of mixed reality to everyone, Simplygon is an important accelerant that makes it easier, faster, and cheaper to develop in 3D.
Introducing Simplygon Cloud
Today, I am excited to announce the launch of Simplygon Cloud on Azure Marketplace. Simplygon reduces complexity in the creation and extensibility of 3D models through optimization. Simplygon supports GLTF, FBX and OBJ file types for ingestion; rendering engines including Unity 3D and Unreal Engine; and all major mixed reality platforms, including Windows Mixed Reality, iOS and Android. 
How it works
Historically, 3D asset optimization has taken days or weeks of manual effort and is one of the tasks that artists and developers dislike the most. With Simplygon, you can create 3D assets once – at full visual fidelity – and automatically optimize them to render smoothly on any platform – within minutes, saving valuable time and money.

As an example, the above left 3D model of a couch was built with 584,000 polygons. To render this content on a lower GPU device, Simplygon optimized this down to 5,000 polygons, which greatly reduces the file size, while maintaining the ideal visual fidelity for the intended device.
How To Get Started
Simplygon Cloud is now available in the Azure Marketplace. To get started, visit our Azure Marketplace home to learn how to deploy the Simplygon Cloud virtual machine and start optimizing your 3D assets. Please also visit our documentation for examples and more information on how to integrate this into your workflow today.
We look forward to sharing more in the months ahead. This is a very exciting time for everyone who is developing in the era of mixed reality!

Windows Developer Day in London – Windows 10 Fall Creators Update SDK Availability

Windows 10 Fall Creators Update provides a developer platform that is designed to inspire the creator in each of us – empowering developers to build applications that change the way people work, play and interact with devices. To truly fulfill this platform promise, I believe that our developer platform needs to be centered around people and their needs.  Technology should adapt and learn how to work with us.
As we showed at Microsoft Build in May, the Windows 10 Fall Creators Update SDK delivers thousands of new capabilities and improvements that support this promise. Today, at Windows Developer Day in London, we’re celebrating three areas that help you, our developer partners:
Create inspiring experiences using the next revolution in technology – Mixed Reality
Modernize applications for the modern workplace
Build and monetize your games and applications
I’m pleased to share with you that you can get started now by downloading the Windows 10 Fall Creators Update SDK. Windows 10 adoption has been incredible – with more than 500 million monthly active devices. We are also seeing devices staying current with the latest updates faster than ever, with the majority of devices running the latest updates in less than 6 months, and over eighty percent of devices running the latest update in less than a year. We can’t wait to see the next wave of innovation enabled by the Windows 10 Fall Creators Update SDK.
Create inspiring experiences using the next revolution in technology – Mixed Reality
The next revolution of computing is Mixed Reality. Microsoft is the only company embracing the entire continuum for mixed reality, from augmented reality to virtual reality and everything in between. Windows 10 was designed from ground up for spatial interactions and the next wave in this journey is Windows Mixed Reality, uniting the digital and real world to create a rich, immersive world. As humans, we interact with space constantly, and Windows Mixed Reality will feel the most natural for users. With HoloLens, we have already demonstrated unrivaled innovation that is transforming industries. Now, our immersive headsets offer unrivaled experiences.
For developers, Windows Mixed Reality offers unique opportunities.
Our unified platform maximizes reuse across platforms and device form factors
Windows Mixed Reality provides reach on the broadest range of devices
Our Microsoft Store provides an unrivaled discovery opportunity
Millions of people come to the Store every day to get an application from our broad catalog
Modernize applications for the modern workplace
With the Windows 10 Fall Creators Update SDK, developers can easily create a new or update an existing application to support modern experiences that employees need, or customers expect.
Modernizing your deployment
The deployment system in Windows 10 has been significantly enhanced to help your users start using your application quicker and easier. This starts with the ability to only download the delta between updates, the updated bits versus the entire package to your end user. In addition, you can break up your application into components to allow streaming install. This will allow your application to work before your user has the entire application installed.
To assist with this modernization, the Fall Creators Update introduces the Windows application packaging project with Visual Studio 2017 version 15.4. This new project allows developers to utilize the app packaging without having to convert your existing installer. Just add the project and you’re done. Once your application is using the modernized installer, you now have access to all the APIs that have been added to the Windows Platform. For example, integration with Windows Hello to assist with security, action center integration to assist with engagement, and cross-device capabilities provided with device relay and activity feed.
Another major investment has been the integration of .NET Standard 2.0 which enables developers to reuse their code across platforms and devices with Visual Studio and integrates the vast array of libraries available in the open source community built on .NET.
Fluent Design System
The Fluent Design System is the evolution of Microsoft’s approach to creating the very best user experiences. Experiences with Fluent Design feel natural on the device you’re using, whether it’s a large screen desktop with keyboard, a laptop or tablet with touch, a mixed reality headset, or one of many other computing form factors. Applications using Fluent Design are optimized for consuming content and are efficient and powerful to use for creating and collaborating, and they help you to achieve more… they are experiences you love to use!
For developers, the Windows 10 Fall Creators Update provides a comprehensive solution for creating applications with Fluent Design in a way that’s simple, powerful and flexible to your needs. It includes UX building blocks, guidelines, samples, tools, and a community to help you build the best experiences for your customers. Here are some highlights:
The Navigation View control provides an easy, consistent home for getting around your app.
Acrylic Material gives you a rich new visual building block that helps you create information hierarchy and greater immersion in your app.
The Reveal Highlight interaction visualization built into many controls helps your experience feel natural to use across as disparate inputs as mouse, pen, touch and gaze.
Connected Animations aid usability by preserving context and increasing engagement, and are so easy to adopt incrementally.
Gesture Actions like swipe build on familiar patterns to help users efficiently and naturally get stuff done.
Learn more about all the different building blocks and features you can take advantage of at:
Device Relay and Activity Feed
Microsoft Graph and Project Rome enable new and exciting ways to drive user engagement across apps, devices and platforms. Device relay allows your customers to continue what they’re doing right now, but on a different device and Activity Feed, allows them to pick up an activity they were doing in the past, and continuing it now or sometime in the future.
Helping your customers stay connected to what they need to do right now isn’t as easy as it used to be. People have multiple devices they switch between and they expect them to all work together. Using the Remote Systems and Remote Sessions APIs, you can do truly delightful device relay scenarios to help your customers use the right device for the task.  The Remote Systems APIs enable you to communicate with the user’s devices across Windows, Android and iOS.
With the Activity Feed, you can keep your customers engaged and help them resume what they need to do next. Your customers can’t always finish what they were doing in a task or session in your app, but you can still help them pick up where they left off between devices and experiences by simply adding an activity to the Activity Feed using the UserActivity API.
Build and monetize your games and applications
Lastly, with the Expanded Resources feature in the Fall Xbox One Update, we’ve made another investment in the promise to open Xbox One to UWP game developers who want to build more immersive experiences. Now, developers will automatically have access to 6 exclusive cores, 5 GB of ram and full access to the GPU with DX12! We designed Visual Studio 2017 with game developers in mind! We built a brand-new work-load based installer in Visual Studio 2017, which optimizes the install experience for game developers, so you get everything you need and nothing you don’t.
We recently launched the Xbox Live Creators Program, and this gives anyone the ability to build and publish games for the Xbox One family of devices and Windows 10 PCs. You don’t have to go through concept approval, and the certification is simplified. What’s more is that you are able to leverage select Xbox Live features like stats, leaderboards and cloud saves. We have added more monetization options and tools in Microsoft Store. Interactivity is the future of live streaming and Mixer is our fast and interactive live streaming platform. We have the Mixer SDKs for the major game engines and languages and you can make something cool in less than an hour. Our goal is to create a community of indie game developers. We want to foster open discussions between developers and Windows, and each other. With that in mind, we are bringing back Dream.Build.Play in 2017. The 2017 Challenge has a prize pool over $225,000 (USD), with several categories.
Community and thanks
We were pleased today to have been joined on stage in London by two creative partners building UWPs for unique and innovative experiences.  Black Marble, a UK based developer is building on its history of simplifying law enforcement experiences with a new Mixed Reality UWP to bring MR to courtrooms. Texthelp, another UK based company, showcased a UWP application and Edge extension that helps improve reading and writing comprehension for children with dyslexia and students learning in a second language. Texthelp has also announced a new app, EquatIO, which assists learning in mathematics.
Whether you’re building immersive experiences for Windows Mixed Reality, games, education or business applications, community is crucial to the Windows developer platform. I’d also like to take a moment to thank all developers who are participating Windows Insiders Program and have been using the Fall Creators Update Preview SDK. We value your insight and suggestions, as well as your feedback.
I look forward to seeing what you create with the Windows 10 Fall Creators Update SDK. The Windows Dev Center is open now for submissions to the Microsoft Store! For more details, go to

New Tools in Windows Device Portal for the Windows 10 Fall Creators Update

In the Windows 10 Fall Creators Update, Device Portal now offers several new tools from across Windows to help you location test your UWP, explore Mixed Reality, build new hardware peripherals and test your apps new installation pipeline. It’s a little bit of goodness for everyone, and we’re excited to share these with you.
If you’re not familiar with Device Portal, you can check out the blog posts below to see what other tools you can find in Device Portal, or look at the new to learn how to enable it.
And as always, all of these tools are backed by a REST API, so that you can use it from a scripting or client application environment using the Device Portal Wrapper.
Location Based Testing
Most of us don’t have the travel budgets to test our apps across the world – but pretending to travel is almost as good!  The Location tool in Device Portal lets you easily change the location that Windows reports to apps. By tapping the “Override” check box, you can swap out the device location for whatever you set using the map or lat/long text boxes. Be sure to uncheck the box when you’re done so that your location (and timezone) come back to reality – every vacation must end…

Figure 1: The News app keeping me up to date with local headlines!
This also works for web pages in Microsoft Edge, letting you test your webpages in different parts of the world.
Some notes on what this tool can and cannot do:
This doesn’t change the locale of your PC! So the News app above still saw an EN-US user in the middle of Italy.
You may not see all apps using this location. Some programs don’t use the Windows API to determine location or have special logic (e.g. using your IP address) to determine your location.
This tool marks the PositionSource of the location data as “Default.” Some apps may check for the source and alter their behavior based on it.
Happy travels!
USB Diagnostics
This one goes out to all the hardware folks – if “HLK” or “WDK” sound familiar, you might find this handy. The USB team has updated the USBView tool to work inside Device Portal, so developers working on new hardware can have more tooling at their fingertips.
The USB Devices tool can be a bit tricky to find – head to the hamburger menu in the top right, and go to “Add tools to workspace.”  Scroll to the bottom and check the “USB Devices” box, then hit “Add.” And voila – a full view of your systems USB hubs, controllers and peripherals. The hubs and controllers expand to show individual devices using the + (plus) sign, and clicking the gear will expand to show the items properties.

Streaming App Install Debugging
The Windows 10 Creators Update added ““streaming installation” for UWP, which allows a user to launch the app before it finished downloading. In order to make this easy to test, the App Model team has added a Streaming Install Debugger tool to Device Portal. To use it, deploy an app with content groups to the device, then open the Streaming Install Debugger. In it you’ll be able to edit the states of the content groups so you can test your apps behavior as streaming install is being simulated and ensure it behaves correctly when content groups are missing.

For more details, check out Andy Liu’s blog posts about the new App Installer and Streaming Install Debugger tools.
Mixed Reality Tooling
One of the bigger splashes in the Fall Creators Update is the addition of Mixed Reality to Windows Desktop. As part of that release, we’re including a suite of tools to help developers build great Mixed Reality apps. Two of these tools may look familiar to HoloLens developers – 3D View and a Framerate counter. There’s also a new app launch option that appears when you have an immersive headset attached to your PC, which lets you launch your app in Mixed Reality.
Frame rate is an important factor in making mixed reality apps comfortable, and it’s important for developers to optimize performance to hit full frame rate on the systems they support. The Frame Rate tool in the Device Portal helps by showing developers both the frame rate of their app and of the system’s compositor.

The 3D View helps when testing your immersive headset’s interactions with the real world, displaying its position as it moves through space.

Finally, what good is tooling if you can’t actually run your app in your immersive headset? Now, when you have an immersive headset attached, the Installed Apps tool will add a button letting you launch the app in the HMD. While fully immersive apps will always run in Mixed Reality, this new button is particularly useful for 2D UWP apps (or apps that switch between 2D and immersive) when you want to test them in Mixed Reality.

As always, if you have ideas for Device Portal that would help you write or debug apps, please leave us a note on our UserVoice or upvote an existing request. If you run into bugs, please file it with us via the Feedback Hub.
Related Posts:
Using Device Portal to view debug logs for UWP
Using the App File Explorer to see your app data