GSoC 2016 - automatic sheet creation - Music/Voice recognition

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

GSoC 2016 - automatic sheet creation - Music/Voice recognition

nns2009
Hi
My name is Igor Konyakhin.
I am 4th-year student at the department of Computer Science of Moscow State University
I have an experience using many programming languages (especially C++, C#, JavaScript). My knowledge of algorithms is quite good and the code I write is easy to understand.
I am a musician as well. I played violin for more than eight years and I like to compose music.
I find writing down notes is inefficient and boring. I wish there would be a faster approach for music sheet creation. My idea is to implement voice recognition so you can just sing/hum the melody into your microphone to get all the notes into the sheet autocatically. What do you think about this idea? Are you interested?

If yes, I have some questions:
1) How do I need to report my progress during the summer?
2) Is it hard to get accepted to this idea? Do I need to do some kind of test-task?
3) If I successfully complete your test-task does it mean I am 100% accepted to GSoC? In other words, do I need to apply to several organizations or is it safe to focus on a particular one?
Reply | Threaded
Open this post in threaded view
|

Re: GSoC 2016 - automatic sheet creation - Music/Voice recognition

Marc Sabatella
I will first try to address the technical aspects of your questions, from my personal perspective as one of the developers:

I think you'll find this is a far more complex topic than you might realize.  Just doing the translation from audio to pitches is hard enough, then on top of that you need to somehow handle the real-time aspect of figuring out appropriate durations to use in notating the music.  The latter problem is hard to enough to solve in itself, and really has no perfect solution, just a series of computer-guesses that often end up need correcting, just as with importing of MIDI files (eg, if a note last 1.14 beats, do we call it a quarter note, a dotted quarter, or quarter tied to sixteenth; if it's the note between C and D, do we call it C# or Db, etc).  That said, being able to do that type of processing in real-time would be extremely useful for people doing MIDI input even without the audio processing.  So solving the basic real-time input problem for the MIDI case seems to me the important first step.  Once that is in place - which may well be more than a single person could get done in a single summer - then the audio procesisng aspect of it could be tackled.

As for the logistics, from my perspective as a mentor, I think these are mostly questions for GSoC as a whole.  I believe you'll find they have very detailed information on the application process.  Regarding test tasks, we don't have a single one, we just suggest people compile MuseScore for themselves and start getting familair with the code, fixing bugs in areas of the code as a way of getting started.  There will probably be more applicants than slots available, so no, there are no guarantees.  Only you can decide what that means in terms of whether you want to apply to several or not.  My guess is that most people probably do, but of course the more organizations you are applying for, the less time you can devote to each proposal, so there is probably benefit in being able to focus on just one or two.

Good luck!

Marc

On Sat, Mar 19, 2016 at 4:10 PM nns2009 <[hidden email]> wrote:
Hi
My name is Igor Konyakhin.
I am 4th-year student at the department of Computer Science of Moscow State
University
I have an experience using many programming languages (especially C++, C#,
JavaScript). My knowledge of algorithms is quite good and the code I write
is easy to understand.
I am a musician as well. I played violin for more than eight years and I
like to compose music.
I find writing down notes is inefficient and boring. I wish there would be a
faster approach for music sheet creation. My idea is to implement voice
recognition so you can just sing/hum the melody into your microphone to get
all the notes into the sheet autocatically. What do you think about this
idea? Are you interested?

If yes, I have some questions:
1) How do I need to report my progress during the summer?
2) Is it hard to get accepted to this idea? Do I need to do some kind of
test-task?
3) If I successfully complete your test-task does it mean I am 100% accepted
to GSoC? In other words, do I need to apply to several organizations or is
it safe to focus on a particular one?



--
View this message in context: http://dev-list.musescore.org/GSoC-2016-automatic-sheet-creation-Music-Voice-recognition-tp7579702.html
Sent from the MuseScore Developer mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Mscore-developer mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mscore-developer

------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Mscore-developer mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mscore-developer
Reply | Threaded
Open this post in threaded view
|

Re: GSoC 2016 - automatic sheet creation - Music/Voice recognition

Tobia Tesan
In reply to this post by nns2009
On 19/03/2016 23:09, nns2009 wrote:
> I find writing down notes is inefficient and boring. I wish there would be a
> faster approach for music sheet creation.

You might be interested in these papers:

http://www.mitpressjournals.org/doi/abs/10.1162/014892603322022673?journalCode=comj#.Vu5y5mErKk0
http://eprints.qut.edu.au/6850/

Apparently, there is a commercial product that actually works:
http://www.staffpad.net/

:)

--
Tobia Tesan
<[hidden email]>
<sip:[hidden email]>


------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Mscore-developer mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mscore-developer
Reply | Threaded
Open this post in threaded view
|

Re: GSoC 2016 - automatic sheet creation - Music/Voice recognition

lasconic
Administrator
On your GSoC questions, please read 


lasconic



2016-03-20 13:59 GMT+04:00 Tobia Tesan <[hidden email]>:
On 19/03/2016 23:09, nns2009 wrote:
> I find writing down notes is inefficient and boring. I wish there would be a
> faster approach for music sheet creation.

You might be interested in these papers:

http://www.mitpressjournals.org/doi/abs/10.1162/014892603322022673?journalCode=comj#.Vu5y5mErKk0
http://eprints.qut.edu.au/6850/

Apparently, there is a commercial product that actually works:
http://www.staffpad.net/

:)

--
Tobia Tesan
<[hidden email]>
<[hidden email]>


------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Mscore-developer mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mscore-developer


------------------------------------------------------------------------------
Transform Data into Opportunity.
Accelerate data analysis in your applications with
Intel Data Analytics Acceleration Library.
Click to learn more.
http://pubads.g.doubleclick.net/gampad/clk?id=278785231&iu=/4140
_______________________________________________
Mscore-developer mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mscore-developer