Quantcast

Cobra - WinLDTP Automation

classic Classic list List threaded Threaded
4 messages Options
bfo bfo
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Cobra - WinLDTP Automation

Hi.
 I stumbled upon Cobra – WinLDTP,  Windows version of Linux Desktop Testing Project open sourced by VMWare
recently. Using this tool, the GUI functionality of an application can be tested in Windows XP SP3, Windows 7 SP1, Windows 8 development release. Libre/OpenOffice is mentioned. Did anybody used LDTP in the past to perform functional, regression testing? More info at http://ldtp.freedesktop.org/wiki.
Best regards.
P.S.
There are traces of automation at wiki.documentfoundation.org:
- smoketest has to be done before any beta or rc build is announced
- full regression test has to be done before every major release
- basic regression test should be done also before every bug fix release
What is the status of those? Are they executed before each release? Any dashboards available?

Michael Stahl-2 Michael Stahl-2
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: Cobra - WinLDTP Automation

hi bfo,

On 25/06/12 23:40, bfo wrote:
>  I stumbled upon Cobra – WinLDTP,  Windows version of Linux Desktop Testing
> Project open sourced by VMWare
> recently. Using this tool, the GUI functionality of an application can be
> tested in Windows XP SP3, Windows 7 SP1, Windows 8 development release.
> Libre/OpenOffice is mentioned. Did anybody used LDTP in the past to perform
> functional, regression testing? More info at
> http://ldtp.freedesktop.org/wiki.

this sounds very interesting, especially this:

> It uses the Accessibility libraries to discover through the application's user interface.

that sounds like the ideal approach to UI testing for me, as it would
automatically test the accessibility interface as well, which is
something that i'm pretty sure nobody tests by hand, so if there are
regressions there they won't be noticed.

> Linux version is LDTP, Windows version is Cobra and Mac version is PyATOM (Work in progress).

can all of these execute the same tests?
surely writing tests 3 times is not the way to go.

btw, i'm not sure if you know this, but there used to be a VCL testtool
in the OOo code base, which was developed by the Sun Hamburg QA
department to do automated UI testing; this tool had serious problems,
such as timing issues requiring to manually litter the tests with
sleeps, so as machines got faster the tests would leave the CPU mostly
idle and take days to run; also i have it on good account that the QA
department actually used a testtool binary built in 2007 and never
upgraded that to the current OOo code later, which does not exactly
instil confidence; testtool was removed from LibreOffice because it was
decided that this is clearly not maintainable.

i wonder what AOO uses for UI testing; perhaps IBM has some internal
thing for that.

> Best regards.
> P.S.
> There are traces of automation at wiki.documentfoundation.org:
> - smoketest has to be done before any beta or rc build is announced

the smoketest (as well as many other automated tests) can be run during
the build simply by calling "make check", and i would hope that our
release builds are built that way.

> - full regression test has to be done before every major release
> - basic regression test should be done also before every bug fix release
> What is the status of those? Are they executed before each release? Any
> dashboards available?

i wonder what "regression test" means here? manual tests, or does it
refer to testtool?

_______________________________________________
List Name: Libreoffice-qa mailing list
Mail address: [hidden email]
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
bfo bfo
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: Cobra - WinLDTP Automation

Michael Stahl-2 wrote
> Linux version is LDTP, Windows version is Cobra and Mac version is PyATOM (Work in progress).
can all of these execute the same tests?
surely writing tests 3 times is not the way to go.
"With LDTP and WinLDTP, the script API part will be the same. The only places where the script writer has to update things would be like - when the widget types between both the platforms are different or the UI object label is different"
More informations:
news article - http://news.efytimes.com/e1/82073/VMWare-Open-Sources--Windows-Version-Of-Linux-Desktop-Testing-Project
developer's blog - http://nagappanal.blogspot.com/

i wonder what AOO uses for UI testing; perhaps IBM has some internal
thing for that.
I have found the following resources:
https://cwiki.apache.org/OOOUSERS/release-qa-plan.html
http://wiki.services.openoffice.org/wiki/Quality_Assurance
http://www.mail-archive.com/ooo-dev@incubator.apache.org/msg20994.html

the smoketest (as well as many other automated tests) can be run during
the build simply by calling "make check", and i would hope that our
release builds are built that way.
Are results of such tests available anywhere?

> - full regression test has to be done before every major release
> - basic regression test should be done also before every bug fix release
> What is the status of those? Are they executed before each release? Any
> dashboards available?
i wonder what "regression test" means here? manual tests, or does it
refer to testtool?
I got it from this article:
http://wiki.documentfoundation.org/QA/Testing/Regression_Tests
Markus Mohrhard Markus Mohrhard
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: Cobra - WinLDTP Automation

>> i wonder what AOO uses for UI testing; perhaps IBM has some internal
>> thing for that.
>>
> I have found the following resources:
> https://cwiki.apache.org/OOOUSERS/release-qa-plan.html
> http://wiki.services.openoffice.org/wiki/Quality_Assurance
> http://www.mail-archive.com/ooo-dev@.../msg20994.html
>
>
The last thing I heard about it is that they are now using it already.
I did not yet have time to look into it and sadly it is another java
based test framework. I plan to have at least a look at it after the
3-6 release.

Regards,
Markus
_______________________________________________
List Name: Libreoffice-qa mailing list
Mail address: [hidden email]
Change settings: http://lists.freedesktop.org/mailman/listinfo/libreoffice-qa
Problems? http://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/
Posting guidelines + more: http://wiki.documentfoundation.org/Netiquette
List archive: http://lists.freedesktop.org/archives/libreoffice-qa/
Loading...