Sketch VR Development Log

博客分类: tech 阅读次数:
VR (1) Unity (1)

Sketch VR Development Log

VR (1) Unity (1)

Raw Materials

Actually it is not only a sketch game. it can also be used for viewing 3D models (For example, VR online shopping for furnitures!). If you are inrerested, it can be further developed into a 3D prototyping tool after adding editing function.

Data Preparation

In this game, players need to sketch the outline of the reference model. So our first task is to prepare our reference dataset. Here I list two most commonly used dataset:

How to draw a line in VR?

The answer lies in the PointLineManager.cs. When pressing the trigger on your controller while moving it. The script will record the position of the controller and use it as new point of the line.

A basic implementation is to use LineRenderer. When player keep pressing the trigger we just keep adding new points to the current LineRenderer using the coordinate of contoller.

Another way is to use MeshLineRenderer.cs. Different form the former, it will create a new mesh which not only has vertices but also has triangle faces. So in this way you can save your sketch as obj while the LineRenderer which doesn’t have meshes can only be saved as .off file.

Basics of Unity

Unity has two modes: Editor & Build. In my practice, I found some functions can only run normally inside Editor mode. For example, AssetDatabase is from UnityEditor namespace which is unavailable in build version. Here is a Solution on StackOverflow.

Scene

If you create an Unity 3D project from scratch, you will start from a defaulted scene where you can create any gameobject you want. In this VR project, we hope to collect some settings before players start to sketch, so we add a 2D start scene before the VR scene.

To select filepath and directory as saving path and model path, one choice is official FileDialog API EditorUtility.OpenFilePanel , but it can only be used in Editor mode. In build mode, we choose StandaloneFileBrowser Asset as substitute. You can search and import this asset in Unity asset store.

PlayerManager.save_dir = StandaloneFileBrowser.OpenFolderPanel("Select Save Folder", "", true)[0];

PlayerManager.namelist_path = StandaloneFileBrowser.OpenFilePanel("Open Namelist File", "", "txt", true)[0];

GameObject

Unity has two “kinds” of gameobject: “Real” physical object & “virtual” script. If you want your script to function during the game, you can create an Empty Object and bind your script to it through Add Component.

If you want to operate on other object in current script. you can use GameObject.Find("the name of other object")

If you want to operate on other script in current script. you can use MyObject.GetComponent<YourScriptName>()

File I/O

  1. How to import .obj files into the game?

Search for Runtime OBJ Importer in Asset Store. Remenber to read the Readme file: You must go to the “Graphics” tab on the right side of Unity Editor, and add “Standard (Specular Setup)” to the always included shaders. This will make your next build take a while

targetPath = "absolute path"
loadedObject = new OBJLoader().Load(targetPath);

Another way is to use Resources.Load() to load .obj file in build mode. In this case, all model files should lie in /Resources directory （You can put/Resources directory under any subdirectory of your project）. But I found some models are displayed abnormally in this method.

targetpath = "path under Resources directory"
loadedObject = Instantiate(Resources.Load(targetPath) as GameObject);
  1. How to save sketch?

I implemented two methods to save sketch:

Meanwhile, we also save timestamps of strokes: a list of (x,y,z,timestamp)

In editor mode, it is defaulted to save 3 types of files: model+sketch, sketch, model. But in buld version, we only save sketch since meshes loaded by Resources is unallowed to be read or saved.

WorldPosition vs. LocalPosition

Since you are not sure the position you are processing is local or World position, the safest way is to transform them into world position first and then do whatever you want.

For example, I need to save vertices of both sketch and model in one single obj file. So, to make sure they share the same coordinate system I first convert their position into world position wv and then to relative position rv.

Vector3 wv = mf.transform.TransformDirection(lv);
Vector3 rv = space.transform.InverseTransformDirection(wv);

VR development (Oculus Rift)

Go to asset store and import Oculus asset.

Get input from controller:

float RI = OVRInput.Get(OVRInput.Axis1D.SecondaryIndexTrigger); //IndexTrigger on right hand controller
bool undoX = OVRInput.GetDown(OVRInput.RawButton.X); //X button on left controller

此处输入图片的描述

More information about Input for Oculus

VR UIs

We can still use traditional Canvas inside VR. But to interact with canvas, mouse activity for 2D display should be replaced by LaserPointer for VR, which you can utilize easily by importing UIHelper prefab from Oculus Asset as a gameobject .

Tutorial: how to build vr uis with unity and oculus rift part 2

Grab/Rotate Objects

Add OVR Grabbable script to the object with Rigid and Collider component that you want to manipulate. And you can use your handtrigger to grab and rotate them.

For example, in this game I put both sketch and model under the same parent gameobject space, which means I only need to add OVR Grabbable script to space to manipulate both the sketch and model.

OVRCameraRig

The OVRCameraRig prefab from Oculus Asset contains the camera for VR and two hand controller gameobjects. You can customize any controller operation with it easily. In my case, I attached a ColorPicker to left-hand controller.

Other Functions

Tutorials

Comments

本文由 Rowl1ng 创作，采用 知识共享署名4.0 国际许可协议进行许可
本站文章除注明转载/出处外，均为本站原创或翻译，转载前请务必署名
本文会经常更新，最后编辑时间为:2020-01-22 14:00:00