Information Systems-Research Experimental Analysis

Research Experimental Analysis

 

Objective:

 

The purpose of this assignment is to help students getting familiar with the process of design and implement experiments for their research projects. Students will review, analyse, design, implement experiments to evaluate the proposed methodology in previous assignment, and report experimental results and findings as well.

 

Tasks:

 

1. Collect your data for experiment

 

1. Identify the available data sources for collection.

 

1. Select the most appropriate data source(s) and start data collection. You are asked to record the data sources that you have found, brief description of the available data using the following sample table:

 

Data

Source

Data

Data File

URL (if

Charge

Target

Source

Organization

Description

Format

available

Fee

data

Name

online)

source

Data 1

Sport Centre,

Exercise

txt

http://xxxxxxx

Free

Yes

VU

training

record

Data 2

…

…

…

…

$1000

No

 

1. Store the collected data in appropriate file format. You need to save the collected raw data, and keep a copy at all times.

 

1. Create a folder called “raw data” to store the collected raw data

 

1. Record your data collection using the following sample table:

 

Data

Date of

Saved File

Saved

Saved File

No. of Data Records

Source

Collection

Location

File

Format

Name

Name

Data 1

15/3/2016

//raw data/

xxxx.txt

txt

2000

Data 3

…

…

…

…

 

 

 

 

 

2. Design and implement experiments

 

1. Adopt data pre-processing. Not all the collected raw data are available as direct input of your methodology.

 

1. Feature selection or dimension reduction. You may need to select some of data features or data records from the entire data collection, not to use all the collected data. In other case, you may need to reduce the dimensionality of the collected data to simplify the data processing in the later stages. You need to save the result data set into a new file. You are asked to record these works using the following sample table.

 

Date

Data

Purpose

Pre-

No.

No.

No.

No.

New

Source

of Pre-

processi

Original

Result

Original

Result

Data

Name

processi

ng

Data

Data

Features

Feature

File

ng

Method

Records

Records

s

Name

20/3/2

Data 1

Clean the

Pre-fill

2000

2000

10

10

Data1_f

016

missing

the

ull.txt

data

missing

values

22/3/2

Data 1

Feature

xxxxxx

2000

2000

10

6

Data1_6

016

Selection

features

.txt

…

Data 3

…

…

…

…

 

1. Design your experiment based on the proposed methodology. The main purpose of experiments is to prove that your methodology can provide expected outcomes. You can follow the experiments that you have read from literatures or any other ways that is suitable for your case. Your experiments procedure need to be detailed recorded, including instruction steps, input data, expected output, potential problems and other related issues. When state the procedure of experiment, you can use extra table, figure, chart, diagram to provide better description.

 

Date

Experiment

Purpose of

Description

Input

Expected

Result File

Experiment

of

Data

Output

Name

Procedure

26/3/

Experiment 1

Evaluate

…

…

…

Output1.txt

2016

Method 1

 

1. To implement your experiment, normally you need to use software/tools or write your own program. Record your experiment results for each run as the references of the following analysis task.

 

3. Result analysis and summary

 

 

 

 

 

 

1. What are the expected results that you want to obtained from the experiment? You need to have a rough idea of what you may have in advance; you cannot wait until the experiment is done.

 

1. Plan your result analysis by thinking of what result you may have first. Write a summary of why you expected to have that results, how they can be linked to your research problems.

 

4. Write up your experiment and result analysis chapter.

 

1. Provide an outline of your experiment and result analysis chapter, including up to four levels of subsections. Only need to list the chapter titles (level 1), section titles (level 2), subsection titles (level 3), and sub-subsection titles (level 4).

 

 

 

Marking criteria

 

 

	Assessment Criteria:				Mark
	Data Collection
	·	Data source list			2
	·	Data collection record			3
Experiment Design and Implementation
	·	Data pre-processing		2
	·  Feature selection or dimension reduction			3
	·	Experiment design		3
	·	Experiment implementation records		2
	Experiment Result Analysis & Summary
	·	The expected results			2
	·  Summarize your expected results to answer research problems				3
Outline of Experiment and Result Analysis Chapter				5
		Total			25