Testing Tools

DMS software is focused on Quality Tools for Software Development. DMS is headquartered in Connecticut, USA and is privately owned.

Website http://www.dynamic-memory.com/

Dynamic Memory Solutions Software Test Tools

Dynamic Profile - The Dynamic Profile delivers the Unix Performance information your staff needs to keep your software running fast. All too often, production jobs run slower than predicted for some reason. A storm of conjecture and blames ensues regarding the diagnosis of the problem. Is it the new patch, the database, the network, a disk, ...? With the Dynamic Profile your operations staff can gather key information to diagnose the problem.

Dynamic Profile - The Dynamic Profile delivers the Unix Performance information your staff needs to keep your software running fast. All too often, production jobs run slower than predicted for some reason. A storm of conjecture and blames ensues regarding the diagnosis of the problem. Is it the new patch, the database, the network, a disk, ...? With the Dynamic Profile your operations staff can gather key information to diagnose the problem.

Dynamic Leak Check for UNIX - Dynamic Memory Solutions offers a complete solution to memory leak problems in the UNIX environment. Primarily targeted at medium to large software companies, Dynamic Leak Check makes leak detection easy and fast. Your programmers, testers and operations team can improve software quality, lower support costs, and increase customer satisfaction simply by using Dynamic Leak Check. The tool is so effective that our customers often experience an immediate total Return On Investment.

Dynamic Code Coverage - The Dynamic Code Coverage user guide may be downloaded by clicking on this link: User Guide Dynamic Code Coverage allows your team to identify untested portions of your code. This measurement leads to more effective testing. Effective testing a cornerstone of software quality. By using, Dynamic Code Coverage your team will improve your software quality immediately.

Dynamic Debug - Dynamic Debug identifies and pinpoints a wide variety of memory errors including:

Overflow errors on heap, stack, global and shared memory.

New/delete, malloc/free errors. C/C++ has a large variety of errors associated with heap memory interfaces.

Interface errors to standard libraries e.g. strcpy, printf

Uninitialized memory access

Accessing memory after free/delete

Null Pointer problems

I/O problems

Want a fast test for response time, file size, and links? WebSitePulse Test Tools provides a series of quick and easy-to-use tests that graph out everything from website speed to link errors. It also provides numbers on file sizes, redirect speed, and DNS.

WebSitePulse is a leading provider of advanced, independent and remote monitoring services that enable clients to increase the efficiency of their mission-critical e-business operations, and to reduce their risk of failed Internet transactions and loss of revenue. Cost-effective, easy-to-use Monitoring Services are available to meet every need and every budget.

Server Monitoring - monitors any type of server, web server or network device as often as every minute with error detection and instant alerts.

Website Monitoring - monitors performance and availability of web sites as often as every minute simultaneously from a global monitoring network. Provides full-page downloads with real-time website alerts, generated if web page errors or website performance problems occur.

Application Monitoring - monitors complex multi-step web transactions and the applications they use. Features simultaneous full-page downloads for every step from multiple cities around the World.

Email System Monitoring with Round-Trip - verifies that your incoming and outgoing email services are working from and end-to-end perspective.

Key Features

• Simultaneous multi-pop web site monitoring from around the Globe

• Precise error detection and "triple stage" verification system

• Forced monitoring upon error detection

• Location correlated notification system with custom settings

• Real-time multi-media alerts with flexible escalation

• Remote hands upon Customer request

• Real-time reports with drill down capabilities and diagnose options

• Multi-user access with individual rights

• 24/7 Live customer support

Customer benefits

• Eliminate the risk of failed Internet transactions and loss of revenue and credibility

• Increase productivity of Web applications and ensure they are always available and running at peak performance

• Provides third party validation of the quality of web applications

• Provides site monitoring from outside the fire wall to demonstrate performance from the end-user perspective

http://www.websitepulse.com/

Test Results Analysis

• SilkTest’s test results file resolves around the test run. For example if you run 3 testcases [via a test suite or SilkOrganizer] all of the information for that test run will be stored in a single results file. There is a viewer to analyze the results of the last test run or X previous to the last run. Errors captured in the results file contain a full stack trace to the failing line of code, which can be brought up in the editor by double-clicking on any line in that stack trace.

• WinRunner’s test results file revolves around each testcase. For example if you run 3 testcases [by hand or via a batch test or TestDirector] 3 test results files are created, each in a subdirectory under its associated testcase. There is a viewer to analyze the results of a test’s last run or if results have not been deleted, a previous run. Double clicking on events in the log often expands that entry’s information, sometimes bringing up specialized viewers [for example when that event is some type of checkpoint or some type of failure].

Managing the Testing Process

• SilkTest has a built-in facility, SilkOrganizer, for creating a testplan and then linking the testplan to testcases. SilkOrganizer can also be used to track the automation process and control the execution of selected groups of testcases. One or more user defined attributes [such as “Test Category”, “Author”, “Module”, etc.] are assigned to each testcase and then later used in testplan queries to select a group of tests for execution. There is also a modest capability to add manual test placeholders in the testplan, and then manually add pass/fail status to the results of a full test run. SilkTest also supports a test suite, which is a file containing calls to one or more test scripts or other test suites.

• WinRunner integrates with a separate program called TestDirector [at a substantial additional cost], for visually creating a test project and then linking WinRunner testcases into that project. TestDirector is a database repository based application that provides a variety of tools to analyze and manipulate the various database tables and test results stored in the repository for the project. A bug reporting and tracking tool is included with TestDirector as well [and this bug tracking tool supports a browser based client]. Using a visual recorder, testcases are added to one or more test sets [such as “Test Category”, “Author”, “Module”, etc.] for execution as a group. There is a robust capability for authoring manual test cases [i.e. describing of each test step and its expected results], interactively executing each manual test, and then saving the pass/fail status for each test step in the repository. TestDirector also allows test sets to be scheduled for execution at a time and date in the future, as well as executing tests remotely on other machines [this last capability requires the Enterprise version of TestDirector]. TestDirector is also capable of interfacing with and executing LoadRunner test scripts as well as other 3rd party test scripts [but this later capability requires custom programming via TestDirector APIs]. Additionally TestDirector provides API’s to allow WinRunner as well as other 3rd party test tools [and programming environments] to interface with a TestDirector database.

External Files

When the tool’s source code files are managed with a code control tool such as PVCS or Visual SourceSafe, it is useful to understand what external side files are created:

• SilkTest implicitly creates *.*o bytecode-like executables after interpreting the source code contained in testcases and include files [but it unlikely that most people will want to source code control these files]. No side files are created in the course of using its recorders. SilkTest does though create an explicit *.bmp files for storing the expected and actual captured bitmap images when performing a bitmap verification.

• WinRunner implicitly creates many side files using a variety of extensions [*.eve, *.hdr, *.asc, *.ckl, *.chk, and a few others] in a variety of implicitly created subdirectories [/db, /exp, /chklist, /resX] under the testcase in the course of using its visual recorders as well as storing pass/fail results at runtime.

Segue Software is a global leader dedicated to delivering quality optimization solutions that ensure the accuracy and performance of enterprise applications. Today Segue® solutions are successfully meeting the quality optimization challenges of more than 2,000 customers around the world, including 61% of the Fortune 100. Our results-oriented approach helps our customers optimize quality every step of the way.

Anyone who has used SilkTest along side any of the other test tools will agree that this is the most function rich out the box. However the learning curve (if you have no programming experience) is the steepest. In my opinion it provides the most robust facilities; an object map, test recovery facilities and object-based development language. Segue's performance test tool SilkPerformer also performs very well compared to it's rivals e.g. LoadRunner, LoadTest, etc.

Segue Website see http://www.segue.com/.

Segue Software Test Tools

SilkCentral Test Manager - Automate your testing process for optimal quality and productivity. SilkCentral Test Manager is an all-inclusive test management system that builds quality and productivity into the testing process to speed the delivery of successful enterprise applications. It lets you plan, document and manage each step of the testing cycle from capturing and organizing key business requirements, tracing them through execution … designing the optimal test plans … scheduling tests for unattended execution … tracking the progress of manual and automated tests … identifying the features at risk … and assessing when the application is ready to go live.

SilkCentral Issue Manager - Resolve issues quickly & reliably by automating the tracking process. An estimated 80% of all software costs is spent on resolving application defects. With SilkCentral™ Issue Manager, you can reduce the cost and speed the resolution of defects and other issues throughout the entire application lifecycle. SilkCentral Issue Manager features a flexible, action-driven workflow that adapts easily to your current business processes and optimizes defect tracking by automatically advancing each issue to its next stage. Its Web user interface provides 24x7x365 access to a central repository of all defect-related information - simplifying usage among geographically dispersed groups and promoting collaboration among different departments. Meanwhile insightful reports enable you to determine project readiness based on the status of important issues.

SilkTest - Meet the time-to-market & quality goals of enterprise applications. SilkTest is the industry-leading automated tool for testing the functionality of enterprise applications in any environment. It lets you thoroughly verify application reliability within the confines of today's short testing cycles by leveraging the accuracy, consistency and time-saving benefits of Segue's automated testing technology. Designed for ease of use, SilkTest includes a host of productivity-boosting features that let both novice and expert users create functional tests quickly, execute them automatically and analyze results accurately. With less time spent testing, your QA staff can expand test coverage and optimize application quality. In addition to validating the full functionality of an application prior to its initial release, users can easily evaluate the impact of new enhancements on existing functionality by simply reusing existing test cases.

SilkTest International - Ensure the reliability of multi-lingual enterprise applications. When it comes to localized versions of global applications, companies traditionally resort to second-class manual testing - a time-consuming and costly process which leaves a large margin of error. SilkTest International changes all that by providing a quick, accurate and fully automated way to test localized applications.

SilkPerformer Component - Optimize component quality and reduce costs by testing remote application components early in development. As the central building blocks of a distributed application, remote application components are key to ensuring application quality. SilkPerformer® Component Test Edition from Segue® lets you test and optimize three major quality aspects of critical remote components early in the application lifecycle - even before client applications are available.

SilkPerformer - Test the limits of your enterprise applications. SilkPerformer® is the industry's most powerful - yet easiest to use - automated load and performance testing solution for optimizing the performance, scalability and reliability of mission-critical enterprise applications. With SilkPerformer, you can accurately predict the "breaking points" in your application and its underlying infrastructure before it is deployed, regardless of its size or complexity. SilkPerformer has the power to simulate thousands of simultaneous users working with multiple computing environments and interacting with various application environments such as Web, client/server, Citrix® MetaFrame®, or ERP/CRM systems - all with a single script and one or more test machines. Yet its visual approach to scripting and root-cause analysis makes it amazingly simple and efficient to use. So you can create realistic load tests easily, find and fix bottlenecks quickly, and deliver high-performance applications faster than ever.

SilkCentral Performance Manager - Optimize the availability, performance and accuracy of mission-critical applications. SilkCentral™ Performance Manager is an application performance management solution for optimizing the quality of mission-critical applications. SilkCentral Performance Manager monitors the end-user experience on three dimensions: availability, accuracy and performance. Active monitoring utilizes synthetic business transactions for service-level and performance monitoring, while passive monitoring provides an understanding of real-user behavior by recording actual user transactions.

Empirix is the leading provider of integrated testing and management solutions for Web and voice applications and VoIP networks.

Empirix Website http://www.empirix.com/

Empirix Software Test Tools

e-TEST suite - A powerful, easy-to-use application testing solution that ensures the quality, performance, and reliability of your Web applications and Web Services. This integrated, full lifecycle solution allows you to define and manage your application testing process, validate application functionality, and ensure that your applications will perform under load. With e-TEST suite, you can deploy your Web applications and Web Services in less time while maximizing the efficiency of your testing team.

e-Manager Enterprise - A comprehensive test management solution that allows you to plan, document, and manage the entire application testing process. Its intuitive, Web-based interface and integrated management modules allow you to set up a customized testing process to fit the needs of your organization.

e-Tester - A flexible, easy-to-use solution for automated functional and regression testing of your Web applications and Web Services. It provides the fastest way to create automated scripts that emulate complex Web transactions. e-Tester then allows you to use these scripts for automated functional and regression testing. The same scripts can also be used in e-Load for load and performance testing and in OneSight for post-deployment application management.

e-Load - A powerful solution that enables you to easily and accurately test the performance and scalability of your Web applications and Web Services. Using e-Load you can simulate hundreds or thousands of concurrent users, executing real business transactions, to analyze how well your Web applications will perform under load. It also allows you to monitor the performance of your back-end application infrastructure, during your load test, to identify bottlenecks and help you tune application performance. e-Load is fully accessible via a Web browser interface, which enables testers and developers to collaborate during the application testing and tuning process.

Rational is now part of IBM, which is leader in the invention, development and manufacture of the industry's most advanced information technologies, including computer systems, software, storage systems and microelectronics. Rational offers the most complete lifecycle toolset (including testing).

When it comes to Object Oriented development they are the acknowledged leaders with most of the leading OO experts working for them. Some of their products are worldwide leaders e.g. Rational Rose, Clearcase, RequistePro, etc.

Their Unified Process is a very good development model that I have been involved with which allows mapping of requirements to use cases, test cases and a whole set of tools to support the process.

If you are developing products using an OO approach then you should include Rational in the evaluation.

Rational Website http://www-306.ibm.com/software/rational/

Rational Tools

Rational Functional Tester - An advanced, automated functional and regression testing tool for testers and GUI developers who need superior control for testing Java, Microsoft Visual Studio .NET, and Web-based applications.

Rational Manual Tester - A manual test authoring and execution tool for testers and business analysts who want to improve the speed, breadth, and reliability of their manual testing efforts. Promotes test step reuse to reduce the impact of software change on manual test maintenance activities.

Rational Performance Tester - IBM Rational Performance Tester is a load and performance testing solution for teams concerned about the scalability of their Web-based applications. Combining ease of use with deep analysis capabilities, Rational Performance Tester simplifies test creation, load generation, and data collection to help ensure that applications can scale to thousands of concurrent users.

Rational Purify - Advanced runtime and memory management error detection. Does not require access to source code and can thus be used with third-party libraries in addition to home-grown code.

Rational Robot - General-purpose test automation tool for QA teams who want to perform functional testing of client/server applications.

Rational Test RealTime - Cross-platform solution for component testing and runtime analysis. Designed specifically for those who write code for embedded and other types of pervasive computing products.

Kind of Tool

automated GUI testing

Organization

BSSE System and Software Enginering

http://www.bsse.biz/

Software Description

AutoPilot is a tool for automated GUI testing by scripts.

• C/C++ like script interpreter compilable, strong typing

• script wizard

• automated script generation from spreadsheets, event tracking, autocode generator

• event and action tracing

• remote script execution / networking capabilities

• verification capabilities

• string and file handling, environment variables

• time-tagged and event-triggered script execution, synchronisation of scripts by (named) semaphores

• test coverage, tracking and analysis

• on-line training facility

• image processing

• random data generation (context-driven)

Platforms

Mac OS 9, Mac OS X.1, Mac OS X.2 (Q4/2002)

MS-Windows Q1/2003

Kind of Tool

24x7 Post Deployment Monitoring of Web Applications

Organization

Empirix

http://www.empirix.com/

Software Description

e-Monitor, a component of the e-Test Suite, provides continuous, comprehensive testing for Web applications after deployment. e-Monitor acts like a quality assurance engineer, testing and reporting failures in real time. Re-using Visual Scripts created with e-Tester, the test authoring tool, e-Monitor schedules comprehensive regression testing around the clock. On detecting a problem, e-Monitor provides a wide variety of corrective actions as well as extensive notification options to alert systems managers to the problem and its nature. Visit our website today for a fully functional free trial at www.empirix.com

Platforms

Windows NT, 95 and 98

Kind of Tool

Automate functional testing

Organization

Redstone Software, Inc.

http://www.redstonesoftware.com/

Software Description

Eggplant is a test automation tool for Mac OS X, which allows automation of almost any manual test. Eggplant tests the end user experience, much as a manual tester would. The interactive scripting development capability allows even an unsophisticated user to start using Eggplant within hours. Eggplant?s capabilities are also powerful enough to support the most complex environments and experienced users. Eggplant?s strengths are its ease of use and learning, its versatility, and its cost-effectiveness.

Eggplant runs on a Mac OS X system but can test any system- under-test attached via standard TCP/IP (local or remote). This allows Eggplant to test not only Mac OS X or Mac OS 9 systems, but also Windows, Unix, Linux, and other environments.

Platforms

Runs on Mac OS X, tests any platform

Kind of Tool

Test-enabled web browser

Organization

Software Research, Inc.

http://www.e-valid.com/

Software Description

eValid's Test Enabled Web Browser (TM) is a test engine that provides you with browser based 100% client side quality checking, dynamic testing, content validation, page performance tuning, and webserver loading and capacity analysis. This new cutting-edge technology is 100% client side based and is completely object oriented. eValid offers a unified approach to WebSite testing that is unique in its simplicity, power, efficiency, effectiveness, and superior ease of use. By focusing entirely on the users' view of WebSite quality. eValid results are accurate, complete, repeatable, and highly effective -- all as experienced by your users. The eValid test engine is available in server product configurations.

• Mapping: eValid Site Analysis and spidering Mode will systematically examine a WebSite or sub-WebSite for critical quality factors such as slow downloading pages, unavailable links, too-long pages.

• Functional & Regression Testing: eValid test scripts can exercise the key parts of your site, confirm links, check content, and simulate users' activities. Make sure your customers get the right message!

• Validation: eValid can confirm selected content, validate document properties, images and applets. Have confidence that you are delivering correct information! Test Suite management as well.

• Loading: eValid load testing scenarios can simulate 100's or 1000's of users. Can your WebSite handle the traffic when a serious crunch comes?

• Tuning: eValid timing capabilities let you identify slow-loading pages so you can "tune-up" your site for optimum performance. Keep customers from clicking away! Transaction monitoring as well.

One integrated product, superbly easy to use, fast to get results. And, priced to respect your budget!

Platforms

Windows Server 2003, Windows NT/2000/XP

Kind of Tool

Windows automation language (freeware)

Organization HiddenSoft

http://www.hiddensoft.com/AutoIt/

Software Description

AutoIt is a simple tool that can simulate key presses, mouse movements and window commands (maximize, minimize, wait for, etc.) in order to automate any windows based task (or even windowed DOS tasks).

There is also an ActiveX control version of AutoIt called AutoItX. This is a stand alone control that can be used to great effect under other scripting languages such as WSH/VBScript.

A pure DLL version of AutoIt called AutoItDLL is also available for adding AutoIt functionality to your own programs and scripts. It includes full function documentation.

Platforms Windows