Ada Compiler Evaluation Suite
languages/ada/ajpo/testing/aces: File Name Size --------- ---- README 1,123 README.html 1,589 WHERE-IS.UNZ 8,379 html/ 1,024 info/ 512 v2.0/ 512 languages/ada/ajpo/testing/aces/html: File Name Size --------- ---- ACES-2.GIF 3,384 README.html 18,458 rm_docs.html 2,040 rm_tests.html 2,174 ug_sec02.txt 7,264 ug_sec03.txt 4,088 ug_sec04.txt 19,654 ug_sec05.txt 54,884 ug_sec06.txt 93,730 ug_sec07.txt 12,252 ug_sec08.txt 5,666 ug_sec09.txt 94,669 ug_sec10.txt 7,260 ug_toc.html 18,809 zd_primr.html 193,422 zd_readg.txt 554,100 zd_userg.txt 317,629 zd_usrxa.txt 7,401 zd_usrxb.txt 6,496 zd_usrxc.txt 182,441 zd_usrxd.txt 24,500 zd_usrxe.txt 41,495 zd_usrxf.txt 69,873 zd_usrxg.txt 15,032 zd_vddoc.txt 10,277 zd_vddxa.txt 434,497 zd_vddxb.txt 121,725 zd_vddxc.txt 49,105 zd_vddxd.txt 23,910 zd_vddxe.txt 5,588 zd_vddxf.txt 11,577 zd_vddxg.txt 5,534 zd_vddxh.txt 2,693 zd_vddxi.txt 1,217 languages/ada/ajpo/testing/aces/info: File Name Size --------- ---- PERFORM.TXT 369 SDD-Oper.ps 1,057,793 SDD-Oper.txt 205,476 SDD-Sppt.ps 818,008 SDD-Sppt.txt 118,508 aces.txt 6,307 changes.zip 55,342 design-tim.html 2,539 documents.html 931 info.html 730 meetings.html 1,329 schedule 2,372 languages/ada/ajpo/testing/aces/v2.0: File Name Size --------- ---- README 15,644 ap-ar-cl.zip 615,108 assessrs.zip 599,130 do-dr-dt.zip 616,374 docs.zip 2,348,029 gn-io-ms.zip 217,188 op-po-sr.zip 784,599 qlook.zip 534,936 st-su-sy.zip 924,118 support.zip 982,179 test/ 512 tk-xh-a9.zip 392,105 languages/ada/ajpo/testing/aces/v2.0/test: File Name Size --------- ---- aces/ 512 languages/ada/ajpo/testing/aces/v2.0/test/aces: File Name Size --------- ---- docs/ 1,024 languages/ada/ajpo/testing/aces/v2.0/test/aces/docs: File Name Size --------- ---- zc_vddxb.ps 204,003 zc_vddxd.ps 67,861 zd_primr.ps 840,581 zd_primr.txt 192,728 zd_readg.ps 2,288,410 zd_readg.txt 564,585 zd_userg.ps 1,373,446 zd_userg.txt 326,888 zd_usrxa.ps 36,074 zd_usrxa.txt 7,805 zd_usrxb.ps 22,791 zd_usrxb.txt 6,679 zd_usrxc.ps 611,535 zd_usrxc.txt 188,786 zd_usrxd.ps 70,214 zd_usrxd.txt 25,141 zd_usrxe.ps 142,266 zd_usrxe.txt 42,782 zd_usrxf.ps 212,787 zd_usrxf.txt 72,077 zd_usrxg.ps 71,874 zd_usrxg.txt 16,464 zd_vddoc.ps 61,187 zd_vddoc.txt 10,695 zd_vddxa.ps 722,968 zd_vddxa.txt 442,854 zd_vddxb.ps 194,662 zd_vddxb.txt 121,725 zd_vddxc.ps 253,097 zd_vddxc.txt 49,138 zd_vddxd.ps 65,698 zd_vddxd.txt 24,903 zd_vddxe.ps 20,797 zd_vddxe.txt 5,718 zd_vddxf.ps 33,959 zd_vddxf.txt 11,900 zd_vddxg.ps 22,447 zd_vddxg.txt 5,689 zd_vddxh.ps 17,484 zd_vddxh.txt 2,781 zd_vddxi.ps 14,261 zd_vddxi.txt 1,241 Totals ============== ============== 108 Files 22,206,126
Ada Compiler Evaluation System (ACES) The purpose of the ACES is to provide a capability for quantitative evaluation of Ada compilation systems. The ACES system is a set of software test programs and associated support tools and procedures which will determine the performance characteristics of Ada compilation systems. This includes the capability to automatically compare the results obtained on different Ada compilation systems. Such comparisons will isolate language constructions where one optimization has particular problems relative to other compilers tested. The ACES will test for the presence of particular compiler optimization. ACES was produced as a merger of the Ada Compiler Evaluation Capability (ACEC) of the United States and the Ada Evaluation System (AES) of the United Kingdom. ACES contains over 3500 files, 1700 of which are compiler performance tests. Over 1000 pages of documentation is included as well. The ACES is not just a test suite -- it defines a process for evaluating Ada83 compilers and a set of support tools. The major steps in using the ACES are: 1. Run the pretest, using the Test harness to generate command files for performing the tests 2. Run a full or partial suite of performance tests 3. Re-run performance tests selectively, as desired, using the Test Harness 4. Run Analysis Programs using the MENU program Support for the analysis of the results is through the Single System Analysis Tool (SSA) and the Comparative Analysis Tool (CA). The MENU program manages the execution of the CA and SSA tools as well as a simple database manager (CONDENSE) and generates reports of the capabilities analyzed. Performance of a single compiler can be evaluated, or multiple compilers can be compared through these tools. Documentation on the ACES includes a Reader's Guide, a User's Guide, a Version Description Document, a Product Specification, and Software Test Plans and Reports. Many people from several different organizations were involved in the ACES project, but Boeing had the contract to actually do the merger. A chronology: Jun 1991 - Agreement to merge the ACEC and AES signed by U.S. and U.K. Apr 1992 - Merger statement of work completed Apr 1992 - Ada/JOVIAL LCF service contract was awarded to CTA, Inc. Jul 1992 - CTA, Inc., subcontracts to Boeing to do the merger Oct 1992 - Critical Design Review Mar 1993 - Formal Qualification Testing Apr 1993 - Delivery of ACES to Ada/JOVIAL LCF May 1993 - ACES available through Data Analysis Center at Rome AFB Sep 1993 - ACES available through the Public Ada Library People from various organizations who worked on the project included: Raymond Szymanski Dan Roy Greg Gicca Pat Donohoe Ken Bowles Neal Altman Barbara Rhoads Bobby Evans Trudy Grube Kim Langdon Jon Wood Sam Ashby Gerry Masters Tom Leavitt Gary McKee Kermit Terrell Dan Eilers Barbara Decker-Lindsey Brad Crawford Julie Leastman Jay Ferguson Phil Brashear Dale Lange ACES User Registration Please register your copy of the Ada Compiler Evaluation System (ACES) with the DoD Ada Validation Facility (AVF) at Wright-Patterson Air Force Base. The AVF is responsible for ACES maintenance and enhancements and is trying to maintain up to date information on organizations using the test suite. ACES users registered with the AVF will be informed of substantive problem reports, work arounds, and future test suite version releases. To register, please contact the DoD AVF at: E-mail email@example.com FAX (513) 255-4585 U.S. mail ACES 645 CCSG/SCSL 3810 Communications Blvd Wright-Patterson AFB OH 45433-5707 or telephone (513) 255-4472 Please provide your name, address, phone number, and E-mail address with your registration. Thank you for your interest in the ACES! NOTE: ajpo/aces is a mirror of the ACES distribution maintained by the Ada Joint Program Office and may be more up to date than swtools/aces
4 Dec 93 First release to the PAL Updated by the Ada Information Clearinghouse
Approved for public release; distribution unlimited For information on how to obtain hard copies of these or any other Ada 9X Project Reports, contact the Ada Information Clearinghouse at 800/AdaIC-11 or 703/685-1477.
This documentation are provided "AS IS" without any expressed or implied warranties whatsoever. No warranties as to performance, merchantability, or fitness for a particular purpose exist. The user is advised to review the documentation thoroughly before relying on it. The user must assume the entire risk and liability of using this documentation. In no event shall any person or organization of people be held responsible for any direct, indirect, consequential or inconsequential damages or lost profits.