Automation Testing Tool: TestComplete

Automation Testing Target: To complete some process by automated method, for improving the efficiency of testing.

Expression:

Functional file: in the process of Automation. All files should be assorted by feature. That means every feature has a correspondence with a functional file for completing a operating by automatically of this feature in Application software (ProductStream). It can use xx_Utilites to be named.

Common Files: there are more functions that direct to some common control in application. All common functions should be analyzed out from function script.

The original Automation Testing Framework:

Disadvantage：

1. There are all functional utilities files in GlobalFiles folder in Framework. It fixed all functional functions and common functions together. It caused some function has been rewritten in every utility, if fact, they should belong to common function. It will bring hard work in automation scripts defending. And another side, some function relates detail in feature, so it will bring some defect in calling function. [Framework functions re-useful is lower.]

2. In Automation area, all interface functions have stored in 2 Library file. In cooperating working, how to control private function name in every functional feature? And how to merge them together? Both are question. [Common function name is unique.]

3. What’s type function can be seen by users (QA team)? Some common function shouldn’t be exposed to them.

4. There are no exception catching and handling in Framework. Log messages aren’t be perfect. No data value comparing. No correct log message controlling.

5. Validation GUI and validation data scripts are poor. GUI validation used XML file to compare, but no baseline standard and validating data just by manual handle.

6. Help documentation is poor. It isn’t professional. It caused by automation testing framework defecting. Created by Visual CHM.

7. The testing data isn’t migrated correctly. It is harm for regression testing. It will let efficacy of using low.

Analysis of Testing Tool

TestComplete is used for functional testing. It is good for a overall testing. And it is easy to installing and implementing. It can improve functional testing, regression testing and HTTP web testing. But in the later period, the defending of script is hander.

Advantage:

1.The GUI testing and scripts has been differentiated.

2.Automation and Manual control testing has been differentiated. At same time, they can be merged in a testing process.

3.Test log can support log analyzed.

4.Event

5.ADO working with DB

6.DbgServices supports a method for exception dealing.

7.Name Mapping：Sometimes recognition attributes of an object, like, a window or a control, change from one application build to another. To run scripts successfully, you should replace the old object names with new ones in the entire project before running the scripts. It can make automation script to be worked correctly.

8.Integrate process operation in LLCollection

9.MS Agent and MS word series software.

10. Storage file: after adding a file to storage, should remove the registry keys and deletes files created.

Application software Automation Testing Framework Design

Test PS (a data lifecycle management software). To implement every operate process in every feature. The target of automation test is to improve the efficiency of manual testing. But in fact, this automation test should separate into two parts, automation and use TC to make a manual testing control.

Design Standard:

1. It should be convenient for defending. The Global files, Common Function files and Functional Utility files that should be separated clearly.

2. Testing data should be created correctly. (Consider as the data base migrate and file format migrate.) This part should cooperate with QA team. For ensuring automation test script can work without error. This standard has especially for every different application.

3. In design, should pay more attention to differentiating the automation testing and manual testing. And how to use the test tool to control all operation of testing.

4. At beginning, all baselines should be created by QA manager.

New Automation Testing Framework Design

This framework’s difficult of implementing is how to separate the functional function (in FuncaionalUtilities Folder) and common function (in GlobalFiles Folder). And if auto_tester want to control all files clearly, he or she should know all functional in tested application software. It is necessary to hold some knowledge of developing. And other side, auto_tester should know the testing data requirement for this application. Read test case or joined the designing test case is be requested. At same time QA tester should understand the functional testing of test tool. And test tool’s using feature.

I have made a test project suite sample in my machine, because that changing in original framework will cost more I think it is better than original. It is regretful that I haven’t study all test cases of PS. So the common function separating just by control feature, it really has defect in automation testing implement.

任何一份自动化测试的框架设计都应该在一开始考虑到一下几点：

1.Common function的建立，这个是建立在对Test case的文档研读上。因为我们的“顾客”是QA tester.而他们的实现对象就是test case.

2．开发经验是很宝贵的.需要一些对GUI的开发经验，要对动态生成的控件有理性了解。就是说最好有些过此方面的代码经验。

3．要考虑到后期的维护。这有利于之后的Regression Testing的设计。

4．GUI和data的Validation方法要与QA team协同解决.