We(Tony Lim and Alejandro Crawford) worked exclusively with kinect for the midterm.
Our initial proposal was to create real-time 3D graphing system of each XYZ joint position and use the data to come up with a musical performance.
We(Tony Lim and Alejandro Crawford) worked exclusively with kinect for the midterm.
Our initial proposal was to create real-time 3D graphing system of each XYZ joint position and use the data to come up with a musical performance.
I used Synapse to get skeletal tracking data, which I then ported into Max/MSP/Jitter via OSC (which is how Synapse sends numbers). I chose the Right elbow & — as a reference — the right hand to demonstrate flexion & the overall extension of said joints.
simple max code compressed here (just copy & paste):
<pre><code>
—————begin_max5_patcher—————
2390.3oc6bkzjihiF8ryeEDD0wLciVXaNU8gNh47bsiNbfMJsoRLv.xYV0zQ
+eezB1F7BHjwJob2givtRAF+zSe6eR0e9zL6k4emTYa8ur9cqYy9ymlMSLDe
fY0+8L6sQeeUZTk31ryHeju7a1OKuDk7cpX3JRpUn+9gy1sMIKkPEeEX8ful
mQyh1RD2+uVlDk131y2QO89kCQ+QAQhO6kQYqse1x115OpukhH5pMIYqWTRV
Qk2EHXtyyVvPwGXj3Obl6b3qvQQUx+S7LAP1kkCmDKfEap8hqmMer+5om3u8
7swKuQ9wEIEmARJ3qQJIYTNmb9GJPR974uka3b2ASRXWcHIZ950ojKRHfKNs
AcMs6ZFBA7oFBFrW.3jYXyoB19vyojsTPIkKHYQKSE+VNimrv5HJYTzPtJqz
Mk3g3KzXWI0f0P0.CsebnCGgz+MQGfQjNVEUP2U1sxwMaBUEiC6kSBDZMR5Y
nDiyCIwTKwbCDCDqCwrkTUEslbFyTRpHzOQUHDRPHdXgxCxm+N20xPb15qCg
7ZZNC+2WIB1uQjvYpHritnAWOAMf.R4BGch4vcr8AMsnHjzeLVpAoGEgdroH
HxURQA5SQfGaJB6GNGxbMg7tAMMGCEsW0pnTBCcNNyYHk81Kf4Vf4WjK8Lh4
ZrmLHm.gfF.Fpim8P6GYJBhENwpEvzjhBFQJ5aIz4qSmuIJKN0.g.0SNUXo6
dA43qUfgdiY7OE4UIzj7Lqu.r9Bz5KnOyXgbgMxtBHczMvfgPvwWxYcYRb0l
nBh0x7x2r9pTmisp403suJuiphMjRh0WWkmlWZ4vdAr.2WgNFJWrMhVl78dE
+PLp08Ygghi9IGn7Gx8QU9KnYtI5I9Moj9.R4uIizGvQTKQWTvMH8MhDbQzp
2rdk+5hTDxLF8BwbURTnLdLOc3jvGMRA.caTXI8HEsbStJe6VRF8LV4+jrdC
052RWl+wnnN4zQHlHOg.ADIMCUWm4qM4Ct3jGO9S9+MK9o68bGTWIQGTCSvC
cti94ubHn.Q8CQHj1IoAe3KGhfUtIJxyn4w9hGO+LuySRKMIirJeWFsI07Ij
4VsTWcxs9GJp+PnzfQO21WBXKtVh2llzFLHrAswhdzcvzFB7yuMKfW3sV7M+
GaSV04WbCDDL7erX0Rly2qQslzxhEH7ueVrjBh0rlVFrbGQRaWVO4bLTUUTu
ppm7OTw5tqr0bd5rcXPiYubYHNVtMdFApBz4FEpyN1IiMWVNScrkgBFYRgWh
oQpZG5oVEVmnpbiSI2YPCkT7+aihUc0fPHG8Urf9iYsH+kRdht79DrfVxXtu
kmjQKxqXlpsjWivK.voW7SrhkdXWoKOYWoB0Y6C.QONaHIbnqzpji1aHIHXZ
uq7j9tgPP+6JOno5Sad0pWJYyDh0uHzM3Ht5MBahkmY0Pqhotr3i7xz3VpSG
FcTrQg6r2bOqPO5jLLHzow1sXfBQfwz21t3BF3HIuSX+ZHr6mnGtZpwqtAc5
TWVv3ZxNlTP2rXadLw5KfOQKOg3P4F3RvIZYHVOYlcaWRJuuY3Vuin6Mjv8b
.1S6DbMUE4X5TUjrXFJXqTrW.gpk28t919PgfAtt19xcJwP6++X1rGqJVHhj
Wn4u75tzzpUkDR1nrY60SKpt0ftX4VGQKSuMDgXOeltgjUpoE1iHIk7NorJI
OqAPmYGUTzX3YM9Jbt7a4kMxOmOTRlbHmCCURdOY+2GIGjsB8z9KdXRJTLBw
R2KxZV.PGmjr0x0o4qdiD27wamWPxRxJ3aX0LZDs924vkiIuFsKkt3xLT6q+
JaM+pe4Kt5Nyl2F57LNHZ8MEcmt9mi2+FwBmayIi3NxhJtvWthMO1UsLpjya
0J4v8Wjlmm19RGVpXx5QYIaYwZRSjfE5b3glrsnLQVhkCiIsgrgIemml15QI
ux6W3JwrUyUjORhoaDOqlTI61SJ1uDXefihSVSpnsGiFstp8HsNuPMEyZpD2
Z7STlk5T6edWyd00sLc8tuIW9j4uJaAKr4Z4opZNMwv9tGJlq6GVXlpVQPyY
aaW+sseczn0Qu+WMBftseccaX8XGqO1zSXj2O7zHB5vd1kiLXj3yVopLDomN
oiloszGifbtbtKWKXftCHXjnkVdHO+f4gfit3ErK97rCpWOj50NrdCPJCaaF
573446pgYLXtD2mrYmmuud3VY5NXuafaAWhaO5ij2Xfq3RP.K90uLoWkuqb0
9IpzVwyVsQHycEMI6PDC+9Qi2mbiaRhia6gV5TqhquEqtB2PgrmhPNXxfXrh
H1axfXfhHFORH9nrMKCcVlVjrU+XwpHV.4xeLq+3olwGaWE8NIdACALkuEQT
ZYxxcToNQyf26LJVVTyKiRqC6+fkiNiNSg.e63R8Gy8UBT7hv+ZOkiQP9zQR
d71hoejjEm+Q8lKUT1dlQv68tFUoygdc1fAxjkc0oAAfwrQkUVkbI4x6cUB7
jsNBHawlzGzPm2iYUBJ6ZdalBC36HO1DxJKokj.Z72Z1RZoV0gTFUQVbbe+6
vSYDNETiDgu34K6FBRqhpLl6qcp0x63Kwxv3zIA+9n8+4Sy7obMseYb.vuwo
qZnx3i4+SD7eYopVleu6Mb+aRCAsDH2E85bbK.NS6tgVe.AP82LzQemywCRc
WxmXy31eVBkmYdfV8aAeXKWxmNRu8qWtHhWgxeF4DjrZa2Dm3FbFmDsilunL
mx2cCMnEwCscx6RV5zryp4pyxJKrY1VJkn94oicdpXmsnoJbBT.NXigFeEPC
hmgMvHvwSA3DXLxwUo0JOygG+IFdTY4BaNgYWfpRyPyfGGUvSn4viBvAFZrk
KrJVlcMmkYrJp6mHicWwyDScGqh5NKKVigGUjmcMH+fUY8BNwviAkmgpfGCp
uqh6Bn4begTwdHxbxOHUrGZN2EHULGZNscjJVCM3hkJJWHWygGkTtL3xkSqv
rthyB2oEdvglEO8J+.LKd.8I+XtbAggp5LELcvCxb5WPUbV.Mm9EzWE8cjYw
SuAqNsnGbfYwSep6.yYND5oZr7foCdPFjebUEOFhePSpxpBUJ5GCZ8QEu6Py
4cWofUMFZ.p3K02bvIPAayHGyhmdCEyv7SuByFjeTw0Nvb9RAJUmNyEqA.Ms
paHfamCATwZHvb.B60GCgMKCMkVwTw8EPW2WxNLexQSiCkSNRZmbbzN8nnwd
Z+0S+efUTVmG
—————-end_max5_patcher—————-
</code></pre>
David Sturman is the poster-child of the data glove. Here’s the poster:
With hindsight fully in mind, the data glove has been resigned to the category of ‘design fail’ — or so it seems. Technologies that move us towards the world of Minority Report
see the glove shrinking. Many Kinect hacks already tout the ability to achieve the ‘Minority Report effect’ with no reliance on a ‘data glove’ at all.
Yet Sturman’s research has proven to be as inspiring as it was influential, the veritable seedbed from which all other related technologies seemingly branched out. In his 1994 essay “A Survey of Glove-based Input,” Sturman describes the lack of dexterity and naturalness at play with respect to control devices of the time. Citing clumsy intermediary designs that constrain human ability to interact with computers, Sturman posits that glove-based designs “let us apply our manual dexterity to the task.” This might seem obvious by today’s standards, given the breadth of today’s control surfaces & input devices, but Sturman goes on, making ‘hand-tracking devices’ his point of departure. Separating them into Position tracking and Optical tracking subcategories, he goes on to describe LED marker systems & silhouette analysis (I’m glossing terribly here).
There’s a poignant line where Sturman discusses the impasses of 1994 camera technologies:
If the performance of camera-based systems improves to the point that they can track individual fingers while maintaining a large visual field, operate in real time, and work without special clothing or encumbering devices, we think certain applications will return to this method of capturing hand motions.
He goes on to discuss magnetic & acoustic tracking, then spends a bit of time parsing out competing glove technologies of the era (even the Nintendo Power Glove makes an appearance). Positing various glove-based applications, ranging from sign language interpretation to robotic control (think puppeteer) to musical performance, Sturman seems optimistic about the possibilities here. Claiming that the field is still in its infancy, he infers that there will be many future applications. Basically he’s like, dude, the glove is gonna be huge. We now know of course that the glove never really became that huge. Maybe it’s still in it’s infancy…
pdf can be read in full here