Literature Review: Mixed Reality for Enhanced Visualization Process

Verified

Added on 2024/06/28

AI Summary

This literature review examines the application of mixed reality (MR) in the automotive industry, focusing on improving the visualization process of manufactured products. It analyzes five journal papers, exploring techniques like augmented reality authoring for maintenance, markerless tracking systems, and vision-based tracking for AR maintenance. The review covers various aspects, including the components of these systems, their processes, advantages, limitations, and validation criteria. Key themes include enhancing industrial maintenance efficiency, improving error detection in small vehicle parts, and reducing costs and time in automotive design and manufacturing using techniques like CAVE (Cave Automatic Virtual Environment). The review highlights both the potential benefits and the existing challenges in implementing MR technologies within the automotive sector, emphasizing the importance of user-AR interaction and addressing issues like camera motion and object tracking.

Literature Review (Secondary Research) Template
Student Name & CSU ID
Project Topic Title Mixed reality in automotive industry for improving visualization process of manufactured products
1

Paraphrase This Document

Need a fresh take? Get an instant paraphrase of this document with our AI Paraphraser

Version 1.0 _ Week 1 (5 Journal Papers from CSU Library)
1
Reference in APA format that will be in
'Reference List'
Erkoyuncu, J. A., del Amo, I. F., Dalle Mura, M., Roy, R., &Dini, G. (2017). Improving efficiency of industrial
maintenance with context aware adaptive authoring in augmented reality. Cirp Annals, 66(1), 465-468.
Citation that will be in the content Erkoyuncu et. al., 2017
URL of the Reference Level of Journal (Q1, Q2, …Qn) Keywords in this Reference
https://www-sciencedirect-
com.ezproxy.csu.edu.au/science/article/
pii/S0007850617300069
Level of journal-Q1 Maintenance, adaptive authoring, industry, Augmented, Data,
framework.
The Name of the Current Solution
(Technique/ Method/ Scheme/
Algorithm/ Model/ Tool/ Framework/ ...
etc )
The Goal (Objective) of this Solution &
What is the Problem that need to be solved
What are the components of it?
Technique/Algorithm name:
Augmentedrealityauthoring for
maintenance model
Tools:Data, Android device, camera,
authoring tools
Applied Area:Maintenance of industrial
Problem:
The major problem is efficiency and
maintenance of industrial equipments.
Goal:
To improve efficiency of industrial operation
and maintenance of equipments using AR.
 Context data framework
 Information data
 Rendering module
 Real and tracking object
 Application platform module
 CAD and 3D model
2

applications
The Process (Mechanism) of this Work; The process steps of the Technique/system
Process Steps Advantage (Purpose of this step) Disadvantage (Limitation/Challenge)
1 Information modulecreates various data
frameworks.
Information gain in sequence with AR Generation of unnecessary data
2 After that Database file generates. Independency of files Connection interrupted
3 Then application implement at application
platform.
Generation of AR content Feedback issues
4 Maintenanceoperation executes. Improve maintenance Equipment error
Validation Criteria (Measurement Criteria)
Dependent Variable Independent Variable
AR content Input from maintenance expert
Adapting information User equipments
Automatic authoring Geographical awareness
Animation process CAD files
Data framework Information module
3

Input and Output Critical Thinking: Feature of this work, and
Why (Justify)
Critical Thinking: Limitations of the research
current solution, and Why (Justify)
Input (Data) Output (View)
Data, key frames,
content, CAM, CDF,
User login ID and
password
Video, animation,
errors, AR content,
Files, manual report
In this research, author explores a model for
industrial maintenance to improve efficiency with
AR technique. But some problems occur in
information system.
There are limitation with information and
maintenance system platform i.e. large amount of
data and equipments.
(Describe the research/current solution) Evaluation Criteria How this research/current solution is valuable
for your project
The current solution provides improvement in
efficiency to maintain industrial equipments
without non-technical maintainers using AR
technique.
This model helps to operators and industrial
maintainers to reduce efforts and improve
efficiency through ARAUM technique and also
helpful for industrial equipments.
This project provides real time data and
information about maintenance of industrial
application by using latest techniques.
Diagram/Flowchart
4

Paraphrase This Document

Need a fresh take? Get an instant paraphrase of this document with our AI Paraphraser

Figure: ARAUM Framework overview
Figure: information framework module
5

Figure: Maintenance module
6

2
Reference in APA format that will be in
'Reference List'
Lima, J. P., Roberto, R., Simões, F., Almeida, M., Figueiredo, L., Teixeira, J. M., &Teichrieb, V. (2017).
Markerless tracking system for augmented reality in the automotive industry. Expert Systems with
Applications, 82, 100-114.
Citation that will be in the content Lima et al., 2017
URL of the Reference Level of Journal (Q1, Q2, …Qn) Keywords in this Reference
https://www-sciencedirect-
com.ezproxy.csu.edu.au/science/article/
pii/S0957417417302221
Level of Journal- Q1 Automotive sector, Augmented reality, Markerless tracking
system, CAD
The Name of the Current Solution
(Technique/ Method/ Scheme/
Algorithm/ Model/ Tool/ Framework/ ...
etc )
The Goal (Objective) of this Solution &
What is the Problem that need to be solved
What are the components of it?
Technique/Algorithm name:
Marker less tracking system, Natural
feature based tracking, Edge based tracking
Tools:
Calibration tool, marker, RGB-D sensor, 3-
d model of object, camera
Problem:The issue is tracking and detection of
small objects and other problem is clarification
condition.
Goal:
To develop applications of AR technology
through natural feature based tracking and real
time visualization for automotiveindustries.
RGB sensor
RGB images
Tracker config XML file
Tracker
CAD system
Model generator
7

Paraphrase This Document

Need a fresh take? Get an instant paraphrase of this document with our AI Paraphraser

Applied Area:
Manufactured products of automotive
industry
3D coordinate system
The Process (Mechanism) of this Work; The process steps of the Technique/system
Process Steps Advantage (Purpose of this step) Disadvantage (Limitation/Challenge)
1 Image extraction Removal extra data NA
2 Generation of model Reconstruct image of small parts Overlapping of images and data
3 Calibration Flexible model of car from calibrator Recovering issue
4 Tracking Detection of small parts of vehicles Projection error
5
Validation Criteria (Measurement Criteria)
Dependent Variable Independent Variable
System model Tracking system
Tracking quality checking method Inlier count and reprojection error metrics
Marker issues Tracking system
3D model Coordinates
Tracking system Natural features of AR
RGB-D images Reconstruction approaches
8

Input and Output Critical Thinking: Feature of this work, and
Why (Justify)
Critical Thinking: Limitations of the research
current solution, and Why (Justify)
Input (Data) Output (View)
RGB-D sequence file,
calibrator module,
calibration data, 3D
point coordinates,
CAD data, video.
Reconstruct model
image, RGB image,
AR objects, 3D key
frames, Mixed reality,
Real world image.
Marker less tracking system provides facility of
error detection in small parts of vehicles. The basic
feature of this technique is development of AR in
automotive industry. But this system faces some
issues during tracking as well as in automation.
 Error detection problem during tracking.
 Projection of Marker creates difficulty.
 Overlapping of images
 Calibration and generation issue.
(Describe the research/current solution) Evaluation Criteria How this research/current solution is valuable
for your project
Lima et al. (2017) examined marker less tracking
system for detection of error in small objects in
vehicles such as car etc. The current solution
provide improvement in automotive industry by
using Mixed and Augmented reality.
This technique is useful for automotive industry as
well as manufacturing products of vehicles. The
tracking system provides best solution to the
industry and their manufacturers through AR.
Tracking system improves AR application in
automotive industries and provides accuracy in
detection of small object. It also reduces
illumination with real time visualization.
Diagram/Flowchart
9

Figure: Tracking area constraint
10

Paraphrase This Document

Need a fresh take? Get an instant paraphrase of this document with our AI Paraphraser

Figure: Proposed method (Flowchart) of the system
3
Reference in APA format that will be in
'Reference List'
Palmarini, R., Erkoyuncu, J. A., Roy, R., &Torabmostaedi, H. (2018). A systematic review of augmented
11

reality applications in maintenance. Robotics and Computer-Integrated Manufacturing, 49, 215-228.
Citation that will be in the content Palmarini et. al., 2018
URL of the Reference Level of Journal (Q1, Q2, …Qn) Keywords in this Reference
https://www-sciencedirect-
com.ezproxy.csu.edu.au/science/article/
pii/S0736584517300686
Level of journal –Q1 Maintenance, tracking, Augmented reality, authoring, digital
engineering
The Name of the Current Solution
(Technique/ Method/ Scheme/
Algorithm/ Model/ Tool/ Framework/ ...
etc )
The Goal (Objective) of this Solution &
What is the Problem that need to be solved
What are the components of it?
Technique/Algorithm name:
Hybrid tracking technique
Vision based tracking technique
Tools:
Engines, Cameras, screen,
vibrotactilebracelet,sensors,HMD
Applied Area:
Industrial maintenance
Problem:The main problem is maintenance of
user-AR interactionand tracking of visual
images.
Goal:To improve maintenance of AR
applications by applying vision based tracking
system.
 Cad based model
 Sensor based tracking
 Vision based HMD
 Context model
12