World Music's DIVERSITY and Data Visualisation's EXPRESSIVE POWER collide. A galaxy of INTERACTIVE, SCORE-DRIVEN instrument model and theory tool animations is born.

Thursday, July 28, 2016

Cantillate

Alternative Music Visualizer Scenarios

The web browser is just one of many potential paths to peer-to-peer teaching and learning over the internet. We look at a few of the choices we made, and which others might lie at our disposal.

Big, brave, open-source, non-profit, community-provisioned, cross-cultural and aquabats crazy. → Like, share, back-link, pin, tweet and mail. Hashtags? For the crowdfunding: #VisualFutureOfMusic. For the future live platform: #WorldMusicInstrumentsAndTheory. Or just register as a potential crowdfunder..

Note: the images in this post are drawn from external sites which you are encouraged to visit for further information.


Care to see some retro music visualisation from the era of Adobe's (in principle legacy, but still widely installed) Flash? If your browser still supports it (read "your security is lax"), the image caption below serves as a link to the original..

Early music instrument and theory visualisation (or visualization) using Adobe Flash
Interference Theory's Visualisation Dashboard


Though apparently neither interactive nor in any way customisable, this is, for my tastes, a remarkable piece of work, combining many of the visual features of the aggregator platform at the centre of this blog's focus, but with slightly more artistic flair.On the other hand, there are plenty of what you might describe as purely 'cosmetic' visualisations. Just one example? Envato. Our aggregator platform, on the other hand, really focusses on giving coherent, visual and above all educational expression to music's underlying mathematical patterns.


Alternative Music Visualizer Scenarios

#VisualFutureOfMusic #WorldMusicInstrumentsAndTheory
Storm Waves on Lewis

Potential Crowdfunder?

Pre-Crowdfunding Registration (* indicates required)
Email Format


Almost 200 years ago, Mendelssohn's tone poem, the overture 'Die Hebriden', Op. 26 helped followers of classical music to a mental picture of the raw majesty of Scotland's atlantic coastline.

One of today's visualisation challenges is similar, but moving from the physical to the abstract: from appreciation of nature to our ability to appreciate and understand music itself -in all it's forms.

We are at a point where we can finally expose the mathematical landscapes underlying our vast and developing musical heritage - and bring these (so to say) to life as the music plays.

In doing so, we will overcome not just geographical barriers, but those of culture, symbolism, language, time zone - and technology.

Like the Scottish coastal landscape, music is in a sense a shifting landscape. New forms and conventions are adopted, old discarded. Cultures clash, mix and settle into new. Taste for adventure? Tourist or individualist? Music visualisation -as a branch of music education or cultural expression- is a young discipline, the field large, pretty level, and full of opportunity for generation of >social value.
Let's explore some of the implementation alternatives to the aggregator platform featured here..

Alternative Scenarios

The range of music visualisation scenarios and tools and libraries available is large:
  • Notation engraving libraries such as Verovio, (engraves MEI music notation into SVG)
Verovio
  • Vexflow is an open-source online music notation rendering API. It is written completely in JavaScript, and runs right in the browser, supports HTML5 Canvas and SVG. A notation engraver system takes it's instructions from an own music formatting language, with the goal of generating high-quality (pseudo-engraved) music scores. It also features a music-mathematical query engine able to answer simple questions about the tonal (modal and harmonic) relations between notes.
  • Game engines and tools (perhaps of particular interest: those that simply work on the web, but can be published to Android and iOS), plus ports of standalone game engines (such as Unreal Engine) to the web. Of Unreal Engine?: "By simply entering a URL, web browser users can access a beautifully rendered, full screen console game experience running at 60 frames per second, with very little download time and no installation required." Smack.ma.gob..
  • Three.js is a cross-browser JavaScript library/API used to create and display animated 3D computer graphics in a web browser. You can find some examples here - with the option of involving other helper libraries such as Tween.js (some examples here).
  • P5.js is a JS client-side library for creating graphic and interactive experiences, based on the core principles of Processing. It supports a WebGL mode, but can also be used in conjunction with D3.js.
  • WebGL and (care!) asm.js
  • Virtual (danger?) and Augmented Reality
Moreover, W3C has begun work towards a new music notation container standard for the web, known -rather cryptically- as MNX.
Various W3C members have begun to showcase experimental scenarios.

You may also like to explore some of the issues (past, present and future) surrounding music and audio in Virtual Reality applications.


Our Scenario

#VisualFutureOfMusic #WorldMusicInstrumentsAndTheoryThe visualization aggregator platform proof-of-concept on which this blog is focussed has been built using javascript, d3.js and (for example for certain animations) the light but promising music theory library teoria.js.
Proof-of-concept focus has been firmly on:
o ease and consistency of integration o ease of personalisation (aggregation) o maximum expressive power in visualisations.
From an implementation point of view, this path allows for a high degree of reuse, and integration of fast and potentially highly sophisticated animations.
Should crowdfunding prove successful, the free but expressively limited Gonville SVG font is likely to be replaced by an SMuFL-compliant font such as Bravura.

Challenges

The key challenges I see in any instrument modelling or theory tool context are those of:
  • style (the often finely nuanced differences in local or regional playing dynamics which ultimately distinguish individual players within an idiom or genre)
  • method (the underlying exercises and techniques by whose means individual style is achieved)
  • tension - primarily a quality of play. There is no secret to producing something tedious from the best of resources.
Whether made at score, instrument model or theory level, there is no support for these inherent to any technical approach. As exemplified by SoundSlice, the best approach is an immersive, multi-media one.

Cantillate

About Cantillate -

Autodidact. Laird o' the Windy Wa's. Serial Failure with Attitude. Bit of a Dreamer..

2 comments

Write comments
Jones Morris
AUTHOR
September 13, 2016 at 5:35 PM delete

Positive site, where did u come up with the information on this posting?I have read a few of the articles on your website now, and I really like your style. Thanks a million and please keep up the effective work.rock music news

Reply
avatar
Cantillate
AUTHOR
September 15, 2016 at 9:02 AM delete

Hallo Rock Music News Thanks for your feedback: my very first :-)

The seeds of this idea began to form some 20 years ago, and I've been systematically garnering links ever since. It wasn't until the recent arrival of data visualisation libraries that I was in a position to start experimenting.

More or less anything that touches on the idea of music visualisation has been bookmarked, making the finding of content for posts more or less straightforward. Pictures are for the main part my own, graphics either self-made, screenshots of the project, or derived (with attribution) from -say- freepix.com.

I also maintain a repository of links in visual form under https://www.pinterest.com/cantillate/.

BTW, as a complete newcomer to blogging, I'd be very happy to achieve the quality and visual clarity of your site.

Cantillate

Reply
avatar

Comments, questions and (especially) critique welcome.