DIY Biomechanics class blog
midterm Kinect Gait Analysis

We(Tony Lim and Alejandro Crawford) worked exclusively with kinect for the midterm.

Our initial proposal was to create real-time 3D graphing system of each XYZ joint position and use the data to come up with a musical performance.

FitBit~

fitbit

fitbit2

Joint Tracking Exercise

I used Synapse to get skeletal tracking data, which I then ported into Max/MSP/Jitter via OSC (which is how Synapse sends numbers).  I chose the Right elbow & — as a reference — the right hand to demonstrate flexion & the overall extension of said joints.

simple max code compressed here (just copy & paste):

<pre><code>

—————begin_max5_patcher—————

2390.3oc6bkzjihiF8ryeEDD0wLciVXaNU8gNh47bsiNbfMJsoRLv.xYV0zQ

+eezB1F7BHjwJob2givtRAF+zSe6eR0e9zL6k4emTYa8ur9cqYy9ymlMSLDe

fY0+8L6sQeeUZTk31ryHeju7a1OKuDk7cpX3JRpUn+9gy1sMIKkPEeEX8ful

mQyh1RD2+uVlDk131y2QO89kCQ+QAQhO6kQYqse1x115OpukhH5pMIYqWTRV

Qk2EHXtyyVvPwGXj3Obl6b3qvQQUx+S7LAP1kkCmDKfEap8hqmMer+5om3u8

7swKuQ9wEIEmARJ3qQJIYTNmb9GJPR974uka3b2ASRXWcHIZ950ojKRHfKNs

AcMs6ZFBA7oFBFrW.3jYXyoB19vyojsTPIkKHYQKSE+VNimrv5HJYTzPtJqz

Mk3g3KzXWI0f0P0.CsebnCGgz+MQGfQjNVEUP2U1sxwMaBUEiC6kSBDZMR5Y

nDiyCIwTKwbCDCDqCwrkTUEslbFyTRpHzOQUHDRPHdXgxCxm+N20xPb15qCg

7ZZNC+2WIB1uQjvYpHritnAWOAMf.R4BGch4vcr8AMsnHjzeLVpAoGEgdroH

HxURQA5SQfGaJB6GNGxbMg7tAMMGCEsW0pnTBCcNNyYHk81Kf4Vf4WjK8Lh4

ZrmLHm.gfF.Fpim8P6GYJBhENwpEvzjhBFQJ5aIz4qSmuIJKN0.g.0SNUXo6

dA43qUfgdiY7OE4UIzj7Lqu.r9Bz5KnOyXgbgMxtBHczMvfgPvwWxYcYRb0l

nBh0x7x2r9pTmisp403suJuiphMjRh0WWkmlWZ4vdAr.2WgNFJWrMhVl78dE

+PLp08Ygghi9IGn7Gx8QU9KnYtI5I9Moj9.R4uIizGvQTKQWTvMH8MhDbQzp

2rdk+5hTDxLF8BwbURTnLdLOc3jvGMRA.caTXI8HEsbStJe6VRF8LV4+jrdC

052RWl+wnnN4zQHlHOg.ADIMCUWm4qM4Ct3jGO9S9+MK9o68bGTWIQGTCSvC

cti94ubHn.Q8CQHj1IoAe3KGhfUtIJxyn4w9hGO+LuySRKMIirJeWFsI07Ij

4VsTWcxs9GJp+PnzfQO21WBXKtVh2llzFLHrAswhdzcvzFB7yuMKfW3sV7M+

GaSV04WbCDDL7erX0Rly2qQslzxhEH7ueVrjBh0rlVFrbGQRaWVO4bLTUUTu

ppm7OTw5tqr0bd5rcXPiYubYHNVtMdFApBz4FEpyN1IiMWVNScrkgBFYRgWh

oQpZG5oVEVmnpbiSI2YPCkT7+aihUc0fPHG8Urf9iYsH+kRdht79DrfVxXtu

kmjQKxqXlpsjWivK.voW7SrhkdXWoKOYWoB0Y6C.QONaHIbnqzpji1aHIHXZ

uq7j9tgPP+6JOno5Sad0pWJYyDh0uHzM3Ht5MBahkmY0Pqhotr3i7xz3VpSG

FcTrQg6r2bOqPO5jLLHzow1sXfBQfwz21t3BF3HIuSX+ZHr6mnGtZpwqtAc5

TWVv3ZxNlTP2rXadLw5KfOQKOg3P4F3RvIZYHVOYlcaWRJuuY3Vuin6Mjv8b

.1S6DbMUE4X5TUjrXFJXqTrW.gpk28t919PgfAtt19xcJwP6++X1rGqJVHhj

Wn4u75tzzpUkDR1nrY60SKpt0ftX4VGQKSuMDgXOeltgjUpoE1iHIk7NorJI

OqAPmYGUTzX3YM9Jbt7a4kMxOmOTRlbHmCCURdOY+2GIGjsB8z9KdXRJTLBw

R2KxZV.PGmjr0x0o4qdiD27wamWPxRxJ3aX0LZDs924vkiIuFsKkt3xLT6q+

JaM+pe4Kt5Nyl2F57LNHZ8MEcmt9mi2+FwBmayIi3NxhJtvWthMO1UsLpjya

0J4v8Wjlmm19RGVpXx5QYIaYwZRSjfE5b3glrsnLQVhkCiIsgrgIemml15QI

ux6W3JwrUyUjORhoaDOqlTI61SJ1uDXefihSVSpnsGiFstp8HsNuPMEyZpD2

Z7STlk5T6edWyd00sLc8tuIW9j4uJaAKr4Z4opZNMwv9tGJlq6GVXlpVQPyY

aaW+sseczn0Qu+WMBftseccaX8XGqO1zSXj2O7zHB5vd1kiLXj3yVopLDomN

oiloszGifbtbtKWKXftCHXjnkVdHO+f4gfit3ErK97rCpWOj50NrdCPJCaaF

573446pgYLXtD2mrYmmuud3VY5NXuafaAWhaO5ij2Xfq3RP.K90uLoWkuqb0

9IpzVwyVsQHycEMI6PDC+9Qi2mbiaRhia6gV5TqhquEqtB2PgrmhPNXxfXrh

H1axfXfhHFORH9nrMKCcVlVjrU+XwpHV.4xeLq+3olwGaWE8NIdACALkuEQT

ZYxxcToNQyf26LJVVTyKiRqC6+fkiNiNSg.e63R8Gy8UBT7hv+ZOkiQP9zQR

d71hoejjEm+Q8lKUT1dlQv68tFUoygdc1fAxjkc0oAAfwrQkUVkbI4x6cUB7

jsNBHawlzGzPm2iYUBJ6ZdalBC36HO1DxJKokj.Z72Z1RZoV0gTFUQVbbe+6

vSYDNETiDgu34K6FBRqhpLl6qcp0x63Kwxv3zIA+9n8+4Sy7obMseYb.vuwo

qZnx3i4+SD7eYopVleu6Mb+aRCAsDH2E85bbK.NS6tgVe.AP82LzQemywCRc

WxmXy31eVBkmYdfV8aAeXKWxmNRu8qWtHhWgxeF4DjrZa2Dm3FbFmDsilunL

mx2cCMnEwCscx6RV5zryp4pyxJKrY1VJkn94oicdpXmsnoJbBT.NXigFeEPC

hmgMvHvwSA3DXLxwUo0JOygG+IFdTY4BaNgYWfpRyPyfGGUvSn4viBvAFZrk

KrJVlcMmkYrJp6mHicWwyDScGqh5NKKVigGUjmcMH+fUY8BNwviAkmgpfGCp

uqh6Bn4begTwdHxbxOHUrGZN2EHULGZNscjJVCM3hkJJWHWygGkTtL3xkSqv

rthyB2oEdvglEO8J+.LKd.8I+XtbAggp5LELcvCxb5WPUbV.Mm9EzWE8cjYw

SuAqNsnGbfYwSep6.yYND5oZr7foCdPFjebUEOFhePSpxpBUJ5GCZ8QEu6Py

4cWofUMFZ.p3K02bvIPAayHGyhmdCEyv7SuByFjeTw0Nvb9RAJUmNyEqA.Ms

paHfamCATwZHvb.B60GCgMKCMkVwTw8EPW2WxNLexQSiCkSNRZmbbzN8nnwd

Z+0S+efUTVmG

—————-end_max5_patcher—————-

</code></pre>

The Data Glove

David Sturman is the poster-child of the data glove.  Here’s the poster:  

                                  sturman  

With hindsight fully in mind, the data glove has been resigned to the category of ‘design fail’ — or so it seems.  Technologies that move us towards the world of Minority Report

                              minority report

see the glove shrinking.  Many Kinect hacks already tout the ability to achieve the ‘Minority Report effect’ with no reliance on a ‘data glove’ at all.  

                

Yet Sturman’s research has proven to be as inspiring as it was influential, the veritable seedbed from which all other related technologies seemingly branched out.  In his 1994 essay “A Survey of Glove-based Input,” Sturman describes the lack of dexterity and naturalness at play with respect to control devices of the time.  Citing clumsy intermediary designs that constrain human ability to interact with computers, Sturman posits that glove-based designs “let us apply our manual dexterity to the task.”  This might seem obvious by today’s standards, given the breadth of today’s control surfaces & input devices, but Sturman goes on, making ‘hand-tracking devices’ his point of departure.  Separating them into Position tracking and Optical tracking subcategories, he goes on to describe LED marker systems & silhouette analysis (I’m glossing terribly here).

There’s a poignant line where Sturman discusses the impasses of 1994 camera technologies:

If the performance of camera-based systems improves to the point that they can track individual fingers while maintaining a large visual field, operate in real time, and work without special clothing or encumbering devices, we think certain applications will return to this method of capturing hand motions.

He goes on to discuss magnetic & acoustic tracking, then spends a bit of time parsing out competing glove technologies of the era (even the Nintendo Power Glove makes an appearance).  Positing various glove-based applications, ranging from sign language interpretation to robotic control (think puppeteer) to musical performance, Sturman seems optimistic about the possibilities here.  Claiming that the field is still in its infancy, he infers that there will be many future applications.  Basically he’s like, dude, the glove is gonna be huge.  We now know of course that the glove never really became that huge.  Maybe it’s still in it’s infancy…

pdf can be read in full here