Roku Developer Program

Join our online forum to talk to Roku developers and fellow channel creators. Ask questions, share tips with the community, and find helpful resources.
cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Software testing for Roku

Hi!

I work a little bit with software testing want to get myself more involved in the Roku Developer community.
If there's any other software testers in the house, feel free to jump onto this thread!

I would like to discuss thinks like:

* How do we choose a smart selection of Roku devices to test on (to cover as many scenarios as possible)
* Test automation framework(s) for Roku players
* How to sniff traffic (Wireshark, Fiddler, Charles etc.)
* How to do stress testing on an app level
* Is there any structured approach to test the stream quality, prevent lag, hiccups in the streams
* How do you conduct compatibility test with the companion apps (iOS and Android)
* Performance testing on the client side?


These are just a few questions. It would be great to start discussing, brainstorming, come up with new test ideas etc. Roku is a super cool platform that will become huge!

Thanks!
Vik
0 Kudos
5 REPLIES 5
dcrandall
Visitor

Re: Software testing for Roku

I don't know if this helps, but:

https://bitbucket.org/markroddy/brstest

I also get the feeling that you want to test this against the oldest model roku you can find, as a stress-test.

A concern that exists is testing this against 'RokuTV'... there you could find yourself against every manufacturer that exists.
0 Kudos

Re: Software testing for Roku

Hi @rollingtester and @dcrandall,

I am new to Roku test automation. My questions match your questions . As with your experience can you suggest me any automation techniques you are following .

Thanks in advance,
Rupesh.
0 Kudos
RokuTomC
Community Moderator
Community Moderator

Re: Software testing for Roku

Hi Vik,

Great thread — I am excited to see the collective wisdom from the community on this, as we don't currently have a standardized process for testing.

As dcrandall suggested, a good rule of thumb to follow is to build for the oldest Roku device possible. You can always add additional graphics, animations, etc. for higher-end models.

If you're not already familiar with our channel certification checklist, it will serve as a good starting point of all the bugs our certification team looks for when reviewing applications for public channels: https://blog.roku.com/developer/2016/06/03/channel-certification-checklist-v2/

Finally, as I told Rupesh in his thread this morning (https://rokutestingportal.centercode.com/callout/?callid=C3D70CF78CBB41C5906C7838A41F24BE), we're opening up beta access to a unit testing framework for automating and testing Roku channels today. If you would like to participate and are willing to provide feedback for the tool, then the first step will be to join our Beta Developers Program. Follow this link to learn more about the Beta Developers Program and signup: https://rokutestingportal.centercode.com/callout/?callid=C3D70CF78CBB41C5906C7838A41F24BE
0 Kudos
RokuTomC
Community Moderator
Community Moderator

Re: Software testing for Roku

Please forgive the delays, but the Unit Testing Framework is now available to the public: https://github.com/rokudev/unit-testing-framework
0 Kudos
arjunbm
Newbie

Re: Software testing for Roku

Nice thread. I am on the same page. So i created separate channels in the Roku slack to discuss these things.

This one for automation - https://rokudevelopers.slack.com/archives/C01H26YQCR2

This one for general testing discussions - https://rokudevelopers.slack.com/archives/C01CTTTU7HT

Feel free to join.

Regards,

Arjun B M(testwitharjun.com)

0 Kudos