ORION mt

Windows 8 & Multitouch - It's HERE!

2011-09-17T15:25:00.009+10:00

Ok so I like so many others was having issues running the PS3 CL-Eye driver using the Windows 8 Developer Preview.

I had tried modifying the USB system drivers from Windows 8 by using the older Windows 7 drivers without success.

Below is a short demo of it working on my table:

And here’s the Backend:

So here’s how I got it to work...
=========================

1). I removed the CL-Eye drivers that I had installed that kept crashing when I tried to run the CL-Eye Test program.

2). Then restarted the system.

3). Installed the older PS3 Eye drivers by AlexP (PS3Eye Camera Setup v3.0.0.0901.exe) <-- Lucky I had this still on my machine!

***EDIT: Here is a LINK for the PS3 Driver

4). Run the test program and Wham! Picture!

5). Installed CCV (I think it was ver1.2 that I had at the time)

6). Downloaded and installed the SurfaceRuntime.msi package from Microsoft

7). Downloaded the BSQSimulator (Release 1.1 AnyCPU.rar) and the Driver (Driver_32Bit-64Bit.rar)

8). Installed the BSQSimulator Driver because I don’t have surface installed on my Windows 8 Drive.

9). Ran CCV, BSQSimulator - (in Administrator mode) and everything works!

I’d be interested in other peoples experiences so please let me know how you go!

App Scroller 1.1 (BETA) Now Available!

2011-04-02T20:13:00.015+11:00

Well as some of you may remember I have been working on an App Scroller based on the original App Loader for Multi-touch Flash applications. I have not done a lot more on the application source code for a very long time and due to popular demand I have posted the source code and instructions so that someone else may finish the job so to speak =)

Below is the source and example applications along with the XML needed to make changes to the menu style.

Download

AppScroller_Source.rar (File Size: 18.12MB - Downloads: )

AppScroller_BETA(EXE).rar (File Size: 2.21MB - Downloads: )

This is an example of the AppList.xml file located in the \src\deploy\www\xml folder:

The Background image can be changed at any time by changing the filename inside the Background tag E.g.

<background>www\img\Backgrounds\Background1.jpg</background>

The Applications are stored inside the

tags and point to the directories where the thumbnails (both top and bottom), file, and descriptions are stored. E.g.

<app>
<title>Pegs</title>
<about>A Multi-touch Pegs Game</about>
<thumb_top>www\img\nuisurface\top_2.png</thumb_top>
<thumb_bottom>www\img\nuisurface\bottom_2.png</thumb_bottom>
<screenshot>www\img\apps\Pegs_screenshot.jpg</screenshot>
<filename>Pegs.swf</filename>
</app>

Please see the AppList.xml file for more information as I have added comments to make customization easier =)

Good Luck!

Cable Making Time!

2011-01-28T17:44:00.007+11:00

So I was hunting around for a particular FFC cable when the same mate at Panasonic told me he had a few 40 pin cables lying around!

I got to modifying them finally and it works! Here are the results =)

Original cable is on top and the one to modify is underneath

All modified and conencted

Up close of the connectors

And yes the screen turns on =)

The DSI Project - Take 2!

2011-01-09T12:49:00.009+11:00

Ok so this is what I think happened...

A long time ago when I first made The DSI Project I must have accidently crimped one of the flat ribbon cables to the LCD module. This didn't cause any problems at the time and as you can see from the video in the last post, it worked just great!

Over approx 6 months there were no issues, then just before Christmas 2010, vertical lines started appearing and changed when pressure was applied to the LCD. With my past experiences in the flat-panel industry I knew this was bad and irreversible.

So I stopped with Mutltiouch for a while angry that I never noticed it before, till a mate of mine at Panasonic donated a 32" TX-32LWD500A LCD to me!

So I'm back! And below are some pics of the new module installed into The DSI Project - Take 2!

This cable needs to be extended... Oh long days ahead for me!

But it all fits! =)

The DSI Project - Part 3 LCD Disassembly

2010-11-08T15:35:00.014+11:00

Below are some Step-by-step shots taken of the disassembly of the LCD used in The DSI Project. It was a 32" TCL brand model L32E9AD.

So What's Next?

2010-11-07T10:28:00.002+11:00

Well now I've made a few different types of Multi-touch devices FTIR, DI, LED-LP, LLP and now DSI...

Now that my DSI project has been done, I think I'm going to move onto different types of multi-touch devices. So where to go from here? Well not sure really, but I think I'll look into how to make Multi-touch screens without modifying existing displays.
Or maybe large wall displays. I would like to create an interactive bench top installed in a kitchen one day...

I can say for sure though... It's been fun! =)

The DSI Project - Part 2

2010-11-04T10:42:00.011+11:00

The DSI Project - Demo Reel from Paul D'Intino on Vimeo.

Hello Again! It's been a long time between posts I know, but I have finally had some time to record the performance of my latest multi-touch table 'The DSI Project' - still haven't come up with a better name =)

This is a Demo Reel of a 32" Multi-touch table showcasing some of the applications used in DIY setups.

Music is by 'The XX's' (website: http://thexx.info/)

This video is also available on YouTube: http://www.youtube.com/watch?v=6vqCVj42y9c

I have also included a diagram explaining the order of the LCD & Touch 'Layers'.
NOTE: The 3 Diffuser Layers are the factory sheets included with the LCD. I had tried variations of using only one or 2, but the result was better with 3 in the end.

As always, stay tuned for more!

"The DSI Project" - Part 1

2010-07-25T23:19:00.021+10:00

Well It's been a busy weekend and I have only just got around to take more pics of the setup. I have named the coffee table "The DSI Project" for lack of a better name =)

The pictures above and left are screenshots of my new Flash AppScroller Menu which I will be releasing in the near future...

Below are some pictures of the inside and make-up of the table, and I have also thrown in a video of the Motorised 3-Port USB Hub that used. It is touch controlled and tucks away nicely when not in use. Makes for a great flush finish...Not bad for AUD$12!

I'll post some specs and measurements hopefully when I get more time...

Until then, as always... Enjoy! =)

The Motorised 3-Port USB Hub:

3-Port Motorised USB Hub from Paul D'Intino on Vimeo.

The first pic is the table complete, and the second is the table with the front bezel off.

Now the side panel must be removed to un-plug the Endlighten panel so it can be removed. (Each side wall is held in with 4 screws and the front and rear have 6)

This is a shot of the LCD panel with a foam surround to protect the edges of the glass panel (I'm not willing to break 2 LCD panels!) The LCD is fixed to a sheet of acrylic - Another sheet of Endlighten in this case which is counter-sunk and fixed into the wood for support and strength.

The top and inside views of the table which I will explain in detail in the next post.

Now the whole table with the pieces.

This is the underside of the bezel showing the cut-out groove for the Endlighten sheet.

The USB Hub, Power socket, Switch and PC Power button...

The finished table... At least for now.. ;-)

32" DSI Multitouch Table [Updated]

2010-07-21T08:31:00.009+10:00

So now I pretty much have the table completed, and only the finishing touches to go.
I've been away on my honeymoon for 7 weeks and only now just getting back to the multitouch table.

Check out the poorly managed, un-optimised, one-handed filming and demonstration of the table using TouchWorldWind JAVA. =)

TouchWWJ First Test from Paul D'Intino on Vimeo.

I used an old Subwoofer terminal plate to house the power switch and AC plug. =)

I'll be adding more info very soon but for now, here's a couple of pics of what the table looks like...

Cheers!

32" DSI Multitouch Table

2010-05-17T12:08:00.009+10:00

For the last couple of months I have been working on a 32" DSI Multitouch table.
There were a few issues in the testing stage where at one point I cracked the LCD ;-(
Very sad times... However, I have a new LCD now and the construction of the table is going very well.

I have attached some pictures of the building stages and will update more when I can.

Enjoy!

(First side of the table)

(Construction coming along)

(Final stages of the construction)

(The lid has been router-ed to house the Endlighten piece)

(Almost final stages)

Concept Apploader Multitouch AS3 Flash Menu

2010-04-09T18:49:00.004+10:00

This is the first trial of a Concept Apploader AS3 Flash Menu that uses an XML dynamic background and Icon/Background images. At this stage the applications are hard coded into the AS3 file, however the aim will be to also have those dynamically load from an XML file.

Screenshots and more details will be added soon...

Comments are welcomed =)

Stay tuned...

Arduino Simple Moisture Tester

2010-02-11T11:08:00.009+11:00

This is a simple Moisture Tester that I made using an Arduino MEGA, a 10 Element Bar Graph LED Array (Part Number: HDSP-4832), and some Galvanized Nails as sensor probes.

Essentially, the Arduino measures the resistance between the nails and sends that data to the code which determines how many LED's to light up. The higher the number, the more LED's light up. Simple!

Here's a picture of the circuit.

And a screenshot of the Serial Monitor output from the Arduino Code:

And here's the code:
------------------------------



// Arduino Simple Moisture Tester
// By Paul D'Intino
// Feb 11 2010

//initialize values
int moistureSensor = 0;
int moisture_val;
int lightSwitch1 = 35;
int lightSwitch2 = 37;
int lightSwitch3 = 39;
int lightSwitch4 = 41;
int lightSwitch5 = 43;
int lightSwitch6 = 45;
int lightSwitch7 = 47;
int lightSwitch8 = 49;
int lightSwitch9 = 51;
int lightSwitch10 = 53;


void setup() {
Serial.begin(9600); //open serial port

//setup Digital pins as Outputs
pinMode (lightSwitch1, OUTPUT);
pinMode (lightSwitch2, OUTPUT);
pinMode (lightSwitch3, OUTPUT);
pinMode (lightSwitch4, OUTPUT);
pinMode (lightSwitch5, OUTPUT);
pinMode (lightSwitch6, OUTPUT);
pinMode (lightSwitch7, OUTPUT);
pinMode (lightSwitch8, OUTPUT);
pinMode (lightSwitch9, OUTPUT);
pinMode (lightSwitch10, OUTPUT);

//set all the LEDS to OFF on startup

digitalWrite (lightSwitch1, LOW);
digitalWrite (lightSwitch2, LOW);
digitalWrite (lightSwitch3, LOW);
digitalWrite (lightSwitch4, LOW);
digitalWrite (lightSwitch5, LOW);
digitalWrite (lightSwitch6, LOW);
digitalWrite (lightSwitch7, LOW);
digitalWrite (lightSwitch8, LOW);
digitalWrite (lightSwitch9, LOW);
digitalWrite (lightSwitch10, LOW);
}

void loop() {
moisture_val = analogRead(moistureSensor); // read the value from the moisture-sensing probes
Serial.print("moisture sensor reads "); //output the value from the sensors
Serial.println( moisture_val );

//Step 1 - setup the maximum value with all LEDS on
if (moisture_val >= 1000 )
{
digitalWrite(lightSwitch1, HIGH);
digitalWrite(lightSwitch2, HIGH);
digitalWrite(lightSwitch3, HIGH);
digitalWrite(lightSwitch4, HIGH);
digitalWrite(lightSwitch5, HIGH);
digitalWrite(lightSwitch6, HIGH);
digitalWrite(lightSwitch7, HIGH);
digitalWrite(lightSwitch8, HIGH);
digitalWrite(lightSwitch9, HIGH);
digitalWrite(lightSwitch10, HIGH);
delay(10);
}

//Step 2
else if (moisture_val >= 800 && moisture_val <= 900 )
{
digitalWrite(lightSwitch1, HIGH);
digitalWrite(lightSwitch2, HIGH);
digitalWrite(lightSwitch3, HIGH);
digitalWrite(lightSwitch4, HIGH);
digitalWrite(lightSwitch5, HIGH);
digitalWrite(lightSwitch6, HIGH);
digitalWrite(lightSwitch7, HIGH);
digitalWrite(lightSwitch8, HIGH);
digitalWrite(lightSwitch9, HIGH);
digitalWrite(lightSwitch10, LOW);
delay(10);
}

//Step 3
else if (moisture_val >= 700 && moisture_val <= 800 )
{
digitalWrite(lightSwitch1, HIGH);
digitalWrite(lightSwitch2, HIGH);
digitalWrite(lightSwitch3, HIGH);
digitalWrite(lightSwitch4, HIGH);
digitalWrite(lightSwitch5, HIGH);
digitalWrite(lightSwitch6, HIGH);
digitalWrite(lightSwitch7, HIGH);
digitalWrite(lightSwitch8, HIGH);
digitalWrite(lightSwitch9, LOW);
digitalWrite(lightSwitch10, LOW);
delay(10);
}


//Step 4
else if (moisture_val >= 600 && moisture_val <= 700 )
{
digitalWrite(lightSwitch1, HIGH);
digitalWrite(lightSwitch2, HIGH);
digitalWrite(lightSwitch3, HIGH);
digitalWrite(lightSwitch4, HIGH);
digitalWrite(lightSwitch5, HIGH);
digitalWrite(lightSwitch6, HIGH);
digitalWrite(lightSwitch7, HIGH);
digitalWrite(lightSwitch8, LOW);
digitalWrite(lightSwitch9, LOW);
digitalWrite(lightSwitch10, LOW);
delay(10);
}


//Step 5
else if (moisture_val >= 500 && moisture_val <= 600 )
{
digitalWrite(lightSwitch1, HIGH);
digitalWrite(lightSwitch2, HIGH);
digitalWrite(lightSwitch3, HIGH);
digitalWrite(lightSwitch4, HIGH);
digitalWrite(lightSwitch5, HIGH);
digitalWrite(lightSwitch6, HIGH);
digitalWrite(lightSwitch7, LOW);
digitalWrite(lightSwitch8, LOW);
digitalWrite(lightSwitch9, LOW);
digitalWrite(lightSwitch10, LOW);
delay(10);
}


//Step 6
else if (moisture_val >= 400 && moisture_val <= 500 )
{
digitalWrite(lightSwitch1, HIGH);
digitalWrite(lightSwitch2, HIGH);
digitalWrite(lightSwitch3, HIGH);
digitalWrite(lightSwitch4, HIGH);
digitalWrite(lightSwitch5, HIGH);
digitalWrite(lightSwitch6, LOW);
digitalWrite(lightSwitch7, LOW);
digitalWrite(lightSwitch8, LOW);
digitalWrite(lightSwitch9, LOW);
digitalWrite(lightSwitch10, LOW);
delay(10);
}

//Step 7
else if (moisture_val >= 300 && moisture_val <= 400 )
{
digitalWrite(lightSwitch1, HIGH);
digitalWrite(lightSwitch2, HIGH);
digitalWrite(lightSwitch3, HIGH);
digitalWrite(lightSwitch4, HIGH);
digitalWrite(lightSwitch5, LOW);
digitalWrite(lightSwitch6, LOW);
digitalWrite(lightSwitch7, LOW);
digitalWrite(lightSwitch8, LOW);
digitalWrite(lightSwitch9, LOW);
digitalWrite(lightSwitch10, LOW);
delay(10);
}

//Step 8
else if (moisture_val >= 200 && moisture_val <= 300 )
{
digitalWrite(lightSwitch1, HIGH);
digitalWrite(lightSwitch2, HIGH);
digitalWrite(lightSwitch3, HIGH);
digitalWrite(lightSwitch4, LOW);
digitalWrite(lightSwitch5, LOW);
digitalWrite(lightSwitch6, LOW);
digitalWrite(lightSwitch7, LOW);
digitalWrite(lightSwitch8, LOW);
digitalWrite(lightSwitch9, LOW);
digitalWrite(lightSwitch10, LOW);
delay(10);
}

//Step 9
else if (moisture_val >= 100 && moisture_val <= 200 )
{
digitalWrite(lightSwitch1, HIGH);
digitalWrite(lightSwitch2, HIGH);
digitalWrite(lightSwitch3, LOW);
digitalWrite(lightSwitch4, LOW);
digitalWrite(lightSwitch5, LOW);
digitalWrite(lightSwitch6, LOW);
digitalWrite(lightSwitch7, LOW);
digitalWrite(lightSwitch8, LOW);
digitalWrite(lightSwitch9, LOW);
digitalWrite(lightSwitch10, LOW);
delay(10);
}

//Step10 - setup the minimum value with all LEDS off but one Red LED.


else
{
digitalWrite(lightSwitch1, HIGH);
digitalWrite(lightSwitch2, LOW);
digitalWrite(lightSwitch3, LOW);
digitalWrite(lightSwitch4, LOW);
digitalWrite(lightSwitch5, LOW);
digitalWrite(lightSwitch6, LOW);
digitalWrite(lightSwitch7, LOW);
digitalWrite(lightSwitch8, LOW);
digitalWrite(lightSwitch9, LOW);
digitalWrite(lightSwitch10, LOW);
delay(10);
}

}

MultiTouch using IR Pen & WorldWind JAVA - Concept Test 1

2010-02-03T11:24:00.001+11:00

This is the first Concept Test of a Multi-touch device using only 1 IR Pen.

Ordinary 'single' touch controls are possible when the IR Pen is touching the screen, and also Multi-touch 'pinch' gestures for zooming by brining the IR Pen closer or further away from the screen.

.

PS3 Eye Lens Test

2010-02-02T11:44:00.015+11:00

With my portable 17" Multi-touch screen I recently built, I have been using the 2.1mm FishEye lens on my PS3 Eye camera with great success.

I have just started a 32" DSI setup and the 2.1mm lens is too distorted to detect blobs on the edge of the screen.

So I recently bought a pack of 6 lenses from DealExtreme to try different angles.
The product is called "2.8mm~16mm Fixed IRIS Lens Set for Webcams and Security/CCTV Cameras (6-Lens Pack)" and it costs USD$14.91.

I have posted a screenshot below of the output from the PS3 Eye using the different lenses.

UPDATED PLANS - Heart Locket 'The Illusionist'

2010-01-04T11:59:00.010+11:00

Even though it is not Multi-Touch related, many people have been asking about the construction of these lockets, so I'll try and explain it. I didn't have time to sit down and actually draw up some plans so I thought I’d better put something on paper before I forgot how I made it!

I made this locket after watching the movie 'The Illusionist'. No-one had successfully made a fully functioning locket, and after searching some forums I found that many people wanted them.

Modifying some plans I found on the forum, I set out to make one and completed it on April 7th 2007 in time for my girlfriend Lisa's birthday.

The following document consists of early diagrams and photos of the finished product (before I glued it into place).

Enjoy!

Download

Heart_Locket_Plans.pdf (File Size: 419KB - Downloads: )

.

Interactive LED Test 2 - First Of The Modules

2009-12-17T23:06:00.010+11:00

Ok so it's been a few months since the post on Interactive LED's. Even though I had already made a module and recorded a video, I had not had the time to upload the video or explain the circuit.

So below is a picture of the circuit in its most basic form. No LED protection for this simple circuit, however building more modules would require a far better design than the one shown...

Circuit Explination:

InfraRed light emmitting from the IR LED transmitter is beamed onto an obstacle (your hand/finger etc.) and reflected onto the IR Receiver (a reverse biased IR LED) which triggers the amplifier to turn on the green LED's.

In the circuit I am using an LM324 - Low Power Quad Operational Amplifier. This is due to the fact that the reflected IR creates a small voltage on the receiver (depends on variables however one test I did was around 150-200mV) and approx 16x gain so 2.4-2.6V on the output.

Being a Quad OP Amp, I had 1 Green LED per output.

Because I only made this module as a "Proof of concept" I have not gone any further with it... Hopefully when I get some time I might come back to this...

Arduino & Servo Control Using The Mouse

2009-11-22T09:42:00.011+11:00

After the iPhone & Arduino project, I wanted to try some mechanical objects with the Arduino MEGA. This is the first test of controlling a Servo connected to the Arduino MEGA by moving the mouse.

The mouse X axis is read by a Processing Sketch and then sent to the arduino to tell the servo to rotate.

I have updated the code to include Y axis, however I only have 1 servo at the moment =P

I will post a new video once I have received more servos...

UPDATE: Here are the Processing and Arduino source codes for this project:

Arduino
ServoAppArduino.pde(File Size: 755 Bytes - Downloads:

Processing
ServoAppTest1.pde(File Size: 1.31KB - Downloads:

Enjoy!

iPhone & Arduino: Controlling 2 LED's Using WiFi

2009-11-21T19:57:00.004+11:00

Ok so it's been quite a while between posts.

I've been working on some projects using the Arduino MEGA.

In this example I've used the iPhone connected to Arduino via WiFi using a custom layout from TouchOSC to control the Green and Red LED's. The application sending information to the Arduino is Processing.

Arduino TouchScreen Test 1

2009-08-02T22:50:00.008+10:00

This is a simple test of a 4-Wire resistive touchscreen connected to an Arduino MEGA running a simple Paint application that I wrote in Processing.

The Arduino code was based on the code from this website:

http://mnicolato.altervista.org/arduino/ardtouch.htm

(The website will need translation, however, the video and code are there)

Below is the Processing code for the Arduino Touch Screen Paint application I wrote for the above video...

Enjoy!


// Touch Screen Paint v1.1 

// This example takes in a serial string of comma-separated values 
// from a 4-Wire Resistive touch screen (0 to 1023), maps them to the range
// 0 to 480 or 0 to 800 of x,y values, and uses them to draw a line on the screen. 

// By 
// Paul D'Intino 


import processing.serial.*; 

float xPos = 0;      //  touch screen x value 
float yPos = 0;      //  touch screen y value 


Serial myPort; 

void setup() { 
  size(800, 480); //define the size of the Paint window
  background(0); //set the background to black
  // List all the available serial ports 
  println(Serial.list()); 
  // Open whatever port is the one you're using. 
  myPort = new Serial(this, Serial.list()[2], 9600); 
  // don't generate a serialEvent() unless you get a new line character: 
  myPort.bufferUntil('\n'); 
} 

void draw() { 

  
} 

void serialEvent(Serial myPort) { 
  // get the ASCII string: 
  String inString = myPort.readStringUntil('\n'); 
  //background(0); 
  if (inString != null) { 
    // trim off any whitespace: 
    inString = trim(inString); 
    // split the string on the commas and convert the 
    // resulting substrings into an integer array: 
    float[] sensor = float(split(inString, ",")); 
    // if the array has at least three elements, you know 
    // you got the whole thing.  Put the numbers in the 
    // color variables: 
    if (sensor.length >=2) { 
      // map them to the range 0-255: 
      xPos = map(sensor[0], 0, 1023, 0, 480); 
      yPos = map(sensor[1], 0, 1023, 0, 800); 
     //define the stroke and fill color of the circle
     stroke(0,255,0); //green (R,G,B)
     fill(0,255,0);   //green (R,G,B)
     //draw the circle at the touch screen sensor x and y position 
     ellipse(yPos,xPos,10,10); 
     //print the serial x,y data for debugging purposes only
    println(inString); 
    } 
  } 
}

The processing app I wrote is a derivative of the Virtual Color Mixer code found here:

http://www.arduino.cc/en/Tutorial/VirtualColorMixer

Stay tuned for more shortly....

Interactive LED Test 1 - More than just a table!

2009-07-26T23:11:00.004+10:00

A while ago I saw some Interactive LED table videos that kinda got me thinking "I should build one of these..." so I did some research and started playing around with IR LED's as sensors. The idea being that the table we use to play cards on could do with some spicing up...

This video shows the first test of a reverse biased IR led used as an IR sensor to power some green LED's. This is the first step to making an interactive LED table using a fairly simple circuit.

(Oh and sorry about the portrait video, I filmed it with my iPhone)

More tests to come...

NUI Group Community Book - Multi-Touch Technologies

2009-06-03T09:36:00.006+10:00

It's here! The first edition release of the NUI Group community book Multi-Touch Technologies.

This book comprises state of the art articles from the NUI Group Community Wiki, as well as several chapters written by leading experts in the field specifically for this publication. Detailing basic hardware technologies as well as the process of developing software suited for multi-touch systems, this book provides a technical introduction to the world of multi-touch.

I am proud to have been a contributer to this book, and my "How-To" section has been included also. Please check it out as it is full of helpful information. Well done to all who made it happen..

Click here to download a copy of the book..

For more info please see the original post here at NUIGroup.

LED-LP 19" Widescreen Multi-touch LCD - First Tests

2009-04-17T00:01:00.005+10:00

So, I've been to Japan and back, but now I've finally found the time to get back into some multi-touch projects I started some months ago. This is my first video of the LED-LP (LED-Light Plane) 19" Widescreen multi-touch LCD prototype I am building.

There are a total of 40 IR LED's around the LCD panel, a PS3 Eye Webcam mounted behind the LCD module, and tbeta running for the blob detection.

This video is of the tbeta main screen where the raw camera feed and applied filters can be seen.

(NOTE: There are some glitches/false inputs being detected and that is due to reflection of IR from the back acrylic onto the LCD's PCB. This can be fixed easily by covering the PCB with non-reflective material.)

So What's Next?

2009-01-30T13:42:00.005+11:00

I have been extremely busy for the last couple of months so I thought I should keep everyone updated on what I've been up to...

I have been working on a portable LED-LP LCD setup which has been on the go for a while now, mainly due to the fact that I have been busy with other things..

Here's a sneak peak...

More to come soon!

CHALKmt - A Multi-Touch Chalk Board Application

2008-11-07T17:04:00.012+11:00

CHALKmt is a multi-touch chalk board application that I made using AS3. CHALKmt allows multi-user/multi-touch interaction of Chalk Boards that can be scaled/rotated/moved and even wiped clean!

There are 2 versions available for download (Wall & Table). The difference between the 2 is the number and position of the '+' buttons that add the Chalk Boards to the screen. The Wall version (ChalkMTWall_Beta 1.0.rar) has 2 top left & top right, while the table version (ChalkMT_Beta 1.0.rar) has 4 on each corner.

This just makes the layout easier for the different Multi-touch setups people are using.

I hope you like it, and as always your feedback is welcome!

Download:

Wall Version: ChalkMTWall_Beta 1.0.rar (1.08Mb)
Table Version: ChalkMT_Beta 1.0.rar (1.08Mb)
MAC Test Version: ChalkMT_Beta 1.0_MAC.zip (4.4Mb)

touchWorldWind Beta is Available Now!

2008-11-06T08:35:00.011+11:00

As we have been promising, there is now a version available for download of touchWorldWind. Please note that touchWorldWind is still a beta version and has only been released due to popular demand.
There are still some ironing out to do with some of the gestures etc, that Taha and I are working on…

Having said that, enjoy the download!

Download: touchWorldWind (2.63Mb)

The download includes a readme file explaining the features/requirements...

POP!mt - A Multi-touch Bubble Wrap Game (Beta 3.1)

2008-10-10T23:13:00.009+11:00

POP!mt (Beta 3.1) is now a Multi-player Bubble wrap game for 1-4 Players.

How to Play:

The aim is to pop all your bubbles before the other players do.
The first player to do so will be prompted with a “Player x Wins” screen.
Pressing Reset clears the canvas of pressed bubbles and starts the game again.

What's New?

- New Player VS CPU 'timed' mode
- Added 'Exit' and 'Continue' buttons
- Selection of 'Widescreen' or 'Normal' table format

Check out the screenshots below and like always, feedback is welcomed!

Download: POP!mt 3.1 Beta (1.8Mb)

Also check out the original NUIGroup post here

MATCHmt - A Multi-Touch Memory Game

2008-10-07T09:14:00.011+11:00

Improve your memory skills!

This is a multi-touch Memory game I made called MATCHmt.

The object of the game is to turn over pairs of matching icons by pressing the tiles. If the icons match, then they are removed from the board. If not, they are returned to their original state. Once all the icons have been matched, the game is over and you win!

It’s a very simple game currently using Farm Icons, but it can be very addictive! It has been designed for kids and adults of all ages.

Hopefully simple games like these will inspire more games...

It is written in Flash AS3 and uses touchlib's OSC to send touch events to the game.

Download: MATCHmt 1.0(1.78Mb)

TouchEarth Name Change

2008-09-08T08:31:00.002+10:00

Due to a confusion between the NUI developed Application called TouchEarth by Pawel Solyga which is an interface to Google Earth and touchEarth~NWW Edition that Taha and I have developed, we have decided to change the name of our application from touchEarth~NWW Edition to touch~WorldWind aka touchWW, to stop any confusion from occuring between the 2 excellent applications.

POP!mt - A Multi-touch Bubble Wrap Game (Part 2)

2008-09-03T17:52:00.009+10:00

POP!mt is now a Multi-player Bubble wrap game for 2-4 Players. The aim is to pop all your bubbles before the other players do.
The first player to do so will be prompted with a “Player x Wins” screen (see below screenshots)
Pressing Reset clears the canvas of pressed bubbles and starts the game again.

I got the idea to make this game from this post and also flash Bubble Wrap game that I’d play to “de-stress” at work. After seeing the above post and the request for Multi-touch from Nuiman, I thought “How hard can that be?” and that’s when POP!mt was born.

At this stage the game uses Mark’s Touch library (as I want to make my own) which can be found here:

I’ve added some screen shots of the game and a Beta version for whoever wants to give it a go.

Feedback is welcomed!

Click the link below to download the game:
POP!mt 2.0 Beta (File Size: 1.39MB)

There is also a quick video on YouTube (or older post here:) showing the very first version in action.

Enjoy!

POP!mt - A Multi-touch Bubble Wrap Game

2008-08-29T15:46:00.003+10:00

This is a multi-touch Bubble Wrap game I made called POP!mt 1.0 Beta version to use on my ORIONmt multi-touch table.

It is written in Flash AS3 and uses touchlib's OSC to send touch events to the game.

The game is still under development for multiple players, menus and timed games.

ORIONmt NASA WorldWind Tilt 1 - touchEarth_NWW

2008-08-28T17:14:00.001+10:00

This is the first test of touchEarth_NWW Edition, our NASA WorldWind Multi-Touch Plugin with the new Tilt code.

The code has been written by myself and Taha. Please see the links on the right column for a link to Taha's Blog

This test is to show the Tilt functionality since the recent modifications to the code.

More tests to come...

ORIONmt NASA WorldWind Multi-Touch Zoom & Pan Test1

2008-08-17T12:46:00.003+10:00

This is the first test of my NASA WorldWind Multi-Touch Plugin. It uses Touchlib's OSC and NASA WorldWind 1.4.
The Video was filmed on my ORION Multi-Touch DI setup.

This test is to show the Zoom and Pan functionality since the modification to the code for panning sensitivity at different altitudes.

There is still the adding of the 'Tilt' function to come, and the 2 finger rotate bug to be fixed properly. I will post more when the code is improved.

More tests to come...

Testing Laser Angles

2008-07-07T23:43:00.003+10:00

I measured one of my lasers and the angle is pretty tight. It measures approx 75-80 degrees (didn't have a protractor! will get one though ;D )

I placed a couple of A4 sheets of paper down on my surface to illustrate the IR laser spread.

I suppose for US$4.30 thats the limitation! I bought 4 of the laser modules, and placement is going to have to be spot on, but it should be OK i think.

The line lens can be replaced with an acrylic rod to maximize angle, but that will be done later if the placement becomes an issue.

Please be careful when playing with High Power IR lasers! especially when you're testing them. I don't want people doing damage to their eyes by staring at the beam of invisible light.

ORION V2 Laser Test 1

2008-07-04T13:42:00.011+10:00

This is my first attempt at implementing a cheap IR laser into the ORION V2.

Essentially the laser creates a horizontal beam of InfraRed light approx 1mm off the glass, which is broken when fingers make contact with the surface of the glass.

This results in the IR camera seeing a bright 'Blob' where the finger has touched the glass.

A great solution to the limitation of using the Multi-touch screens during the day or under a lot of ambient lighting. A big thankyou to AlexP for the Laser idea!

And don't forget to visit the post at the NuiGroup forum here

Long time between posts

2008-06-17T09:16:00.002+10:00

It's been a while since I have updated this site, and to those who visit regularly it's about time I said something! So, at the moment I am adding improvements to the NASA World Wind multi-touch plugin, and at this stage there still seems to be a rotating issue. As you pull your fingers apart the globe zooms in and the software detects that the fingers are moving away from each other at speed. The problem is that the rotate function is very similar. It is very hard to drag 2 fingers away from each other without rotating them slightly around a central point, hence rotate and zoom seem to be tied. It is something that I will need to debug for some time to get right (otherwise I will remove the rotate function!)

Also I am currently toying with the idea of Multi-touch Texas Hold'em and a Touch event based BlackJack. The BlackJack doesn't need to be Multi-touch, I just think it would be nice in my AppLoader menu as one of the games ;-)

As more information becomes available I will let you know.

UPDATED - NASA World Wind Plugin

2008-05-23T10:45:00.006+10:00

When I fully tested the plugin I found that it was all over the place. So I recompiled the plugin and I fixed some issues like correct long/lat movement, fixed pinch and spread measurements and now I'm looking into why it goes weird when you reach the dateline / poles. Also the rotate is a little off and needs attention.

Try this one out for some fixes, but more updates soon… (hopefully)

Download:

UPDATED_DanTouchEarthPlugin.rar (file size: 10kb)

See the updated post on NUI Group here

NASA World Wind Plugin

2008-05-20T16:01:00.016+10:00

Ok, so it's been a long time coming, and I have stumbled onto a plugin for NASA World Wind. http://oldspeak.net/worldwind/ Unfortunately, this version doesn't work :( However, our good friend at NUI Skeeet, has re-compiled it, and we have a working version!

Here's a quote from the original website:

WorldWind Multitouch Plugin

This is a rudimentary, stub, C# WorldWind plugin which listens for multitouch input using the TUIO protocol, and interprets a basic set of finger gestures to control WorldWind. Supported gestures are single finger drag to spin the globe, pinch and spread to zoom, and two-finger rotate to roll the camera.

You’ll need:

* NASA WorldWind 1.4
* A working installation of touchlib or reacTIVision (or for testing, TUIO Simulator)

To run the plugin:

Copy DanTouchEarthPlugin.dll into your WorldWind 'Plugins' folder, start WorldWind, and use the Plugins menu to load the 'DanTouchEarthPlugin' plugin. Once the plugin is loaded, it will start listening for TUIO events. Next, use touchlib (run OSC.exe) or (easier) the JAVA TUIO_Simulator to generate TUIO events.

Please see the original post at NUIGroup here for more info.

Download:

You can download a working version from here: DanTouchEarthPlugin.rar (file size: 10kb)

I've tested the plugin using Using OSC + simple-2point.avi and it works very well.

The movement is limited but finally a plugin for Nasa WW that I happened to stumble onto while surfing the net! Yay!

More testing to come!

NOTE: I have updated this post and download link to refer to the newer one.

Please see updated link here

How I built ORION mt

2008-05-11T10:47:00.047+10:00

The ORION mt table has been one of the smoothest/responsive DI (Diffused Illumination) tables that I have built. Below is a video of the ORION mt in it's prototype state.

You can view the original post on the NuiGroup forum here

Please see the Showcase post on Nui Group forums here:

Here is a short explanation on how it was built.

Rear Diffused Illumination: DI - The Theory:

Infrared light is shined at the screen from below the touch surface from. A diffuser is placed on the bottom of the touch surface. When an object touches the surface it reflects more light than the diffuser or objects in the background. The extra light is sensed by an Infrared camera. Below are pictures illustrating the effect of DI and also a screenshot an image captured by the camera.

The above images and text have been extracted from the NUI Group wiki

The Box:
Made out of 12mm craft wood (MDF), the box is 710mm(w) x 775mm(l) x 655mm(h). I left a section on the top of the box so that I could mount a small mirror to increase projection throw.

The Projector:
For the projection I'm using a SHARP DLP projector Model: PGM15S

Table Specs:
My PC is an AMD Athlon 64X2 Dual Core 3600+ with 2GHz RAM, Nvidia GeForce 7600gt Graphics Card. Sharp PG-M15S projector, Frosted Glass as diffuser/projection/surface.

The resolution that I am using is 1024x768 (DVI to DVI).

WebCam Specs:

The camera is an Xbox Vision 360 (AUD$50) (I’m using 320x240 res @ 60fps)
This camera was fairly easy to modify the IR filter.

Also our friends Jose & Vasco (jmccd) from NUI Group have summarized our posts on the forum and made a pdf guide which you can download here

See the original NuiGroup post here

IR Illuminators:

In the ORION mt there are 3 illiminators. I’ve drawn up a crappy picture in MS Paint to show the layout of the illuminators. (1x 140 IR Leds, 1x 80 IR Leds and a smaller 45 Led illuminator too!)

Illuminator number 1 is the 140 IR led I got from a mate. Number 2 is the 80 IR Led I made up, and Number 3 is the 45 Led one.
The purple border represents the physical screen projection size in relation to the illuminators and the box.

The need for more IR light was due to the fact that during the day or close to a IR light source (overhead lights or the sun) the IR that I was generating was not enough to receive clear blobs.

WebCam & Projector Placement:
Here are some pictures to illustrate the camera, mirror and projector placements in the ORIONmt. I originally had a camera angle issue where i wanted to place the camera in the middle of the floor facing upwards, however I could not capture the entire screen. To overcome this, I ended up moving the camera to reflect of the 2nd mirror. That way I can capture the entire screen (with overscan)

See below:

I have also added a beamer/mirror placement applet that may help with design of your own multi-touch display.

Please see below:

Beamer/Mirror Placement Guide Applet

IR Illuminators - detail
The 140IR LED Illuminator was originally bought by my mate from ebay, and I found one similar on ebay (after typing in the search bar of ebay "140 IR Led"), so here are some specs on it.

- Built-in sensor (which I taped over)

- Illuminating range: Detecting range is 80m, viewing range is 60m (outdoor)

- Definition Consumed power: 18W

- Wave length : 850nM

- Structure: All weather aluminum and reinforced glass

- Power: DC 12V 1000mA

Because of the narrow beam of this IR illuminator, I was getting a large hotspot on the glass. To get around this, I have angled the 140 IR Illuminator so that the light is emitted and reflected off the side wall of the box. (please see above pics)

Also, the placement of the illuminators can be seen in the picture below...

Glass Specs
The sheet of glass is 4mm thick, 71cmx56cm frosted (sandblasted) on one side for the diffuser/projection surface. It was bought from a glass manufacturer, cut to size while I waited and cost about AUD$40-50.

I will add photos soon...

More soon....

App Loader (+ User Background Image) Plus Guide!

2008-05-07T11:01:00.022+10:00

AppLoader (+ user background image) is now available. I have modified the code slightly to allow for a background image of your choice to be displayed.

Click on the link to download: AppLoader.rar (Size: 3.33Mb)

Screenshots:

A long Press (5 seconds) will activate the pop-up menu to allow you to exit the program by pressing 'x'...see above pics

I have also written this easy guide for anyone who wants to make there own.

Before i start, I have included the files needed to run your own AppLoader so don't worry. :-) Also, I am an absolute beginner at flash so if I can do it, so can you!

I have also included the source files if you wanna make your own changes too :) ... I didn't write this program (and I can't find out who did - it's not in the readme on the SVN), but it's really easy to modify so here goes...

Getting Started:

1) Download the attached file below.

2) Once you have extracted the files, they should be added in your [b]'deploy'[/b] directory (e.g. C:\Multitouch\touchlib\AS3\src\deploy and make sure that the global flash security settings link to the swf or folder.

http://www.macromedia.com/support/documentation/en/flashplayer/help/settings_manager04.html

(I selected my entire directory (/src) and added it to the site to make sure that any program I put in the 'src' or 'deploy' directory will run without an issue. )

Adding Apps / Editting AppLoader:

So now I'm gonna try and explain how to edit it... There is a script inside the AppLoader.as file that enables custom background images when activated. I have already done this and given you the AppLoaderBack.exe file for that.

The Background image can be changed at any time by changing the file "\deploy\www\img\apploaderBack.jpg".

Applications can be added by editing the file "\deploy\www\xml\applist.xml"

I edited the applist.xml file and added the name of the program I wanted. Under the Category in the applist.xml file you will find the name of the program (e.g. WaterRipples) and the description to be displayed (Water Ripples for fun). The AppLoader will then look for the file “WaterRipples.swf” in the ‘deploy’ directory to try and load it when the load button is pressed. (NOTE: AppLoader only loads .swf files).

If you change the ‘name’ in the applist.xml file, then you need to change the .swf name in the deploy directory.

Here’s a sample of my applist.xml file:

<app>
<name>WaterRipples</name>
<body>Water Ripples for fun</body>
</app>

Sometimes if though you do this, the app still wont load! I’ve found that a different build of the app (.swf) may fix this.

To get the screenshots and thumbnails to work, you’ll need to put the files under "\deploy\www\img\apps" They are (E.g. “WaterRipples_screenshot.jpg” and “WaterRipples.png")
You must make the name the same as the name listed in the applist.xml file for the images to be displayed. The Thumbnail size default is 72x72 and the Screenshot file is 395x295.

I’m running 2 types of Ripples. One is the default (Blue screen - ripples.swf) and the other is called WaterRipples (by wSatori), which can be customizable to display a video background, pebbles, still images...etc.

You can find it here:

wSatori's WaterRipples

DI Multi-touch Test 1 - ORION v2

2008-04-30T15:05:00.009+10:00

This blog has been designed for a Multi-touch DI setup I made called ORION mt. Here are some apps to show the performance of the Multi-Touch interface. Please see the original post on Nui Group forums here:

ORION mt 3D Model

2008-04-30T14:43:00.009+10:00

I am up to the stage where building a more professional frame for the table is required, so I downloaded Google SketchUp and created a 3D model of the ORION Multi Touch Table. It's very basic and is only intended as a visual aid for my engineering friend (more so for dimensions) who will help me design the frame properly.

ORION mt

Windows 8 & Multitouch - It's HERE!

App Scroller 1.1 (BETA) Now Available!

Cable Making Time!

The DSI Project - Take 2!

The DSI Project - Part 3 LCD Disassembly

So What's Next?

The DSI Project - Part 2

"The DSI Project" - Part 1

32" DSI Multitouch Table [Updated]

32" DSI Multitouch Table

Concept Apploader Multitouch AS3 Flash Menu

Arduino Simple Moisture Tester

MultiTouch using IR Pen & WorldWind JAVA - Concept Test 1

PS3 Eye Lens Test

UPDATED PLANS - Heart Locket 'The Illusionist'

Interactive LED Test 2 - First Of The Modules

Arduino & Servo Control Using The Mouse

iPhone & Arduino: Controlling 2 LED's Using WiFi

Arduino TouchScreen Test 1

Interactive LED Test 1 - More than just a table!

NUI Group Community Book - Multi-Touch Technologies

LED-LP 19" Widescreen Multi-touch LCD - First Tests

So What's Next?

CHALKmt - A Multi-Touch Chalk Board Application

touchWorldWind Beta is Available Now!

POP!mt - A Multi-touch Bubble Wrap Game (Beta 3.1)

MATCHmt - A Multi-Touch Memory Game

TouchEarth Name Change

POP!mt - A Multi-touch Bubble Wrap Game (Part 2)

POP!mt - A Multi-touch Bubble Wrap Game

ORIONmt NASA WorldWind Tilt 1 - touchEarth_NWW

ORIONmt NASA WorldWind Multi-Touch Zoom & Pan Test1

Tag Cloud

Testing Laser Angles

ORION V2 Laser Test 1

Long time between posts

UPDATED - NASA World Wind Plugin

NASA World Wind Plugin

How I built ORION mt

App Loader (+ User Background Image) Plus Guide!

DI Multi-touch Test 1 - ORION v2

ORION mt 3D Model