Attend XDA's Second Annual Developer Conference, XDA:DevCon 2014!
5,729,266 Members 41,903 Now Online
XDA Developers Android and Mobile Development Forum
View Poll Results: Which threads are the most useful to analyse?
ROM threads 41 87.23%
Kernel threads 25 53.19%
Theme/App threads 3 6.38%
General threads 5 10.64%
Threads for other devices 2 4.26%
Multiple Choice Poll. Voters: 47. You may not vote on this poll

[REF] ICS User Experience Graphs (sentiment analysis)

Tip us?
 
bedalus
Old
#51  
bedalus's Avatar
Recognized Contributor - OP
Thanks Meter 8499
Posts: 6,218
Join Date: Jun 2011
Location: Chester
Nice work! I wonder if this can be automated? Also, perhaps sentiment can be tracked over time by supplying a set of posts from week to week.

kernels ; battery ; ROM ; gov/sched
Now with summaries in the first posts. Convenient for XDA app users!
For various benchmarks, see my threads: >here<
 
bedalus
Old
(Last edited by bedalus; 22nd April 2012 at 03:34 PM.)
#52  
bedalus's Avatar
Recognized Contributor - OP
Thanks Meter 8499
Posts: 6,218
Join Date: Jun 2011
Location: Chester
[ROM][4.0.4]Slim ICS 68MB- Clean, Simple &amp; Fast - The Google Way
http://forum.xda-developers.com/show....php?t=1390118
Click image for larger version

Name:	slimICS.png
Views:	88
Size:	8.8 KB
ID:	1018841
http://sentimentanalyzer.appspot.com/

And: http://text-processing.com/demo/sentiment/ gives 70% negative


EDIT: Again, this sentiment analysis stuff is a work in progress. tchaari is helping to improve the accuracy, but we may need to change the way we mine the data from the threads.
Attached Files
File Type: xlsx Analysis.xlsx - [Click for QR Code] (126.7 KB, 3 views)
 
bedalus
Old
(Last edited by bedalus; 22nd April 2012 at 04:31 PM.)
#53  
bedalus's Avatar
Recognized Contributor - OP
Thanks Meter 8499
Posts: 6,218
Join Date: Jun 2011
Location: Chester
Found this: http://wiki.metalayer.com/index.php?title=API_Sentiment

I can do this in windows:

curl http://api.metalayer.com/s/datalayer/1/sentiment -d "text=In 1972, a crack commando unit was sent to prison by ... A-Team."

Returns a slightly negative sentiment. (-0.5 on a scale from -5 to 5)

...using this version of curl: http://www.paehl.com/open_source/?CURL_7.24.0
(top most download)


I also found this list of sites: https://sites.google.com/site/twitte...ther-resources
The Following User Says Thank You to bedalus For This Useful Post: [ Click to Expand ]
 
bedalus
Old
#54  
bedalus's Avatar
Recognized Contributor - OP
Thanks Meter 8499
Posts: 6,218
Join Date: Jun 2011
Location: Chester
These people seem to have a nice service (including a free option): http://www.alchemyapi.com/api/gstarted.html

...and there is an SDK so I may try to integrate this directly into my C++ program rather than relying on curl.
For various benchmarks, see my threads: >here<
 
tchaari
Old
#55  
tchaari's Avatar
Senior Member
Thanks Meter 1357
Posts: 1,124
Join Date: Dec 2011
Quote:
Originally Posted by bedalus View Post
Nice work! I wonder if this can be automated? Also, perhaps sentiment can be tracked over time by supplying a set of posts from week to week.
Yes bedalus. It can be automated. A HTTP request (call of a web page from a program with strings at the place of input box) can be done using any language curl, C++, Java...
This is discussion about how to do it in C++
http://stackoverflow.com/questions/1...request-with-c
- Official Nexus S and Nexus S 4G maintainer in Slim Roms Team
- If you like my work, please hit thanks or donate to our team in order to maintain our servers (we pay for them).
The Following User Says Thank You to tchaari For This Useful Post: [ Click to Expand ]
 
bedalus
Old
#56  
bedalus's Avatar
Recognized Contributor - OP
Thanks Meter 8499
Posts: 6,218
Join Date: Jun 2011
Location: Chester
Quote:
Originally Posted by tchaari View Post
Yes bedalus. It can be automated. A HTTP request (call of a web page from a program with strings at the place of input box) can be done using any language curl, C++, Java...
This is discussion about how to do it in C++
http://stackoverflow.com/questions/1...request-with-c
Wow, programming is amazing. I'll try to build that example into a c++ program tomorrow. Then I'll see if I can do a full page of text to the api (there is a character limit). I'll aim to attach dates too.

http://www.alchemyapi.com/api/sentiment/textc.html

The above link gave me a slightly positive rating for my rank of word-triples for Slim ICS, whereas other sites had given negative. After looking at the word triples manually, it seems the sentiment is definitely positive. I think this is a good sign that the api will prove to be reliable... perhaps it will be more reliable with virgin text. Exciting!
For various benchmarks, see my threads: >here<
 
bedalus
Old
#57  
bedalus's Avatar
Recognized Contributor - OP
Thanks Meter 8499
Posts: 6,218
Join Date: Jun 2011
Location: Chester
UPDATE: Checked my original program for tallying threads worked when threads got longer. Expected behaviour was to only read the necessary pages and update the .dat file. Unfortunately, it reads the new pages, and replaces the .dat file. Fixed now (I think... I have to wait until a thread gets longer to test).

I cannot understand how to integrate curl into c++ so I will just use system calls and place a prebuilt curl program in system32. It's an easy workaround.
For various benchmarks, see my threads: >here<
 
bedalus
Old
#58  
bedalus's Avatar
Recognized Contributor - OP
Thanks Meter 8499
Posts: 6,218
Join Date: Jun 2011
Location: Chester
UPDATE: Nearly have it working.

I have threads sending their entire text (but no quotes) to the sentiment api in 400 word chunks, with scores returned.

I plan to share the results as a graph.
For various benchmarks, see my threads: >here<
 
tchaari
Old
(Last edited by tchaari; 24th April 2012 at 10:13 AM.)
#59  
tchaari's Avatar
Senior Member
Thanks Meter 1357
Posts: 1,124
Join Date: Dec 2011
Quote:
Originally Posted by bedalus View Post
UPDATE: Nearly have it working.

I have threads sending their entire text (but no quotes) to the sentiment api in 400 word chunks, with scores returned.

I plan to share the results as a graph.
wow, this is very very interesting bedalus. Are you interested to mount a software engineering company with me? lol
EDIT: I am thinking about the next challenge: smoothness benchmark
- Official Nexus S and Nexus S 4G maintainer in Slim Roms Team
- If you like my work, please hit thanks or donate to our team in order to maintain our servers (we pay for them).
 
bedalus
Old
(Last edited by bedalus; 24th April 2012 at 12:11 PM.)
#60  
bedalus's Avatar
Recognized Contributor - OP
Thanks Meter 8499
Posts: 6,218
Join Date: Jun 2011
Location: Chester
Quote:
Originally Posted by tchaari View Post
wow, this is very very interesting bedalus. Are you interested to mount a software engineering company with me? lol
EDIT: I am thinking about the next challenge: smoothness benchmark
Don't know if I'll have the time to go global...

Program now works completely. I can't share it yet, I just need to write a method to import my private key from a file. Then other people can use it (but would need to get their own key). It wouldn't be much work, but unless I get demand for that, I actually think will just keep it private for now.

... because now it's working well, I will start working on a public chart!

EDIT: Okay, here's the new graph format, shows the accumulation of sentiment. So far only NexusMV (CM9 base) visible.

Link: https://docs.google.com/spreadsheet/...zVlMmZzNlhwSWc
For various benchmarks, see my threads: >here<

Tags
benchmark, best kernel, best rom, kernel, rom
THREAD CLOSED
Subscribe
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes