Tracking your selenium tests

Transcript

1. Tracking your selenium tests Haroon Rasheed - Test Lead Automation

   @haroonzone

2. • Selenium Java Client Libraries • TestNG • Selenium Grid

   1.0.8 • Jenkins & Anthill Pro • Web Driver / Selenium 2 • Watir-WebDriver • ReportNG • Maven

3. • Selenium Tests: 2086 • Pre-production environments • Limited production

   or service availability tests

4. When test fails... • When it started failing? • Does

   it fail consistently in an environment? • Does it fail for the same reason all the time?

5. Summary ####### % Tests passed (methods passed): 67.92% % Tests

   skipped: 22.64% % Tests failed: 9.43% ####### Raw figures ####### Total methods passed: 108.0 Total number tests skipped: 36.0 Total number tests failed: 15.0 Total time: 102838 seconds.
6. None

7. Shared Network Drive\\fileserver\ iexplore7-on- windows\ci\20091205\index.html

8. TestNG Listeners <listeners> <listener class-name="org.uncommons.reportng.HTMLReporter"/> <listener class-name="com.ft.testng.db.LogResultsToDatabaseTestListener"/> </listeners>

9. None

10. Cuanto & TestNG Listener (http://www.trackyourtests.com) <listeners> <listener class-name="com.ft.testng.db.CuantoListener"/> </listeners>

11. None
12. None
13. None
14. None
15. None

16. Splunk, Annotations and Test Listeners (JUnit, TestNG, Concordion, Spock) @UserStory("US1234")

    @Tags({"cms", "ft.com"}) @TestApproach(testDefined = Stage.BEFORE_DEVELOPMENT, testImplemented = Stage. AFTER_DEVELOPMENT, engagement = Involved.WHOLE_TEAM) @Customers("Joe Bloggs") @Testers({"John", "Rita"}) @Developers({"Alex", "Chris"}) @StoryScope(type = StoryType.NEW_FUNCTIONALITY, scope = Scope.PAYING_CUSTOMER)

17. Test Result as JSON to Splunk Logger

18. Q & A http://pragmaticqa.co.uk/blog/ https://github.com/haroonzone/cuanto-testng-listener [email protected]