PAL CARD CATALOG ENTRY

SHORT DESCRIPTION

Ada Compiler Evaluation Suite


MOVEMENT WITHIN THE PAL CARD CATALOG
Move to top-level taxonomy
Move to keyword list

ASSET PROFILE

UNIT NAME
AJPO/ACES
VERSION
1.0
ORIGIN
AJPO
REVIEW CODE
OK
INET ADDRESS
action@ajpo.sei.cmu.edu
AUTHOR
See individual files
RIGHTS
Approved for public release; distribution unlimited
COPYRIGHT
See individual files
LOCATION
ajpo.sei.cmu.edu
PAL

FILE LISTING

Directory Display


languages/ada/ajpo/testing/aces:
  File Name                 Size
  ---------                 ----
  README                   1,123
  README.html              1,589
  WHERE-IS.UNZ             8,379
  html/                    1,024
  info/                      512
  v2.0/                      512

languages/ada/ajpo/testing/aces/html:
  File Name                 Size
  ---------                 ----
  ACES-2.GIF               3,384
  README.html             18,458
  rm_docs.html             2,040
  rm_tests.html            2,174
  ug_sec02.txt             7,264
  ug_sec03.txt             4,088
  ug_sec04.txt            19,654
  ug_sec05.txt            54,884
  ug_sec06.txt            93,730
  ug_sec07.txt            12,252
  ug_sec08.txt             5,666
  ug_sec09.txt            94,669
  ug_sec10.txt             7,260
  ug_toc.html             18,809
  zd_primr.html          193,422
  zd_readg.txt           554,100
  zd_userg.txt           317,629
  zd_usrxa.txt             7,401
  zd_usrxb.txt             6,496
  zd_usrxc.txt           182,441
  zd_usrxd.txt            24,500
  zd_usrxe.txt            41,495
  zd_usrxf.txt            69,873
  zd_usrxg.txt            15,032
  zd_vddoc.txt            10,277
  zd_vddxa.txt           434,497
  zd_vddxb.txt           121,725
  zd_vddxc.txt            49,105
  zd_vddxd.txt            23,910
  zd_vddxe.txt             5,588
  zd_vddxf.txt            11,577
  zd_vddxg.txt             5,534
  zd_vddxh.txt             2,693
  zd_vddxi.txt             1,217

languages/ada/ajpo/testing/aces/info:
  File Name                 Size
  ---------                 ----
  PERFORM.TXT                369
  SDD-Oper.ps          1,057,793
  SDD-Oper.txt           205,476
  SDD-Sppt.ps            818,008
  SDD-Sppt.txt           118,508
  aces.txt                 6,307
  changes.zip             55,342
  design-tim.html
                           2,539
  documents.html             931
  info.html                  730
  meetings.html            1,329
  schedule                 2,372

languages/ada/ajpo/testing/aces/v2.0:
  File Name                 Size
  ---------                 ----
  README                  15,644
  ap-ar-cl.zip           615,108
  assessrs.zip           599,130
  do-dr-dt.zip           616,374
  docs.zip             2,348,029
  gn-io-ms.zip           217,188
  op-po-sr.zip           784,599
  qlook.zip              534,936
  st-su-sy.zip           924,118
  support.zip            982,179
  test/                      512
  tk-xh-a9.zip           392,105

languages/ada/ajpo/testing/aces/v2.0/test:
  File Name                 Size
  ---------                 ----
  aces/                      512

languages/ada/ajpo/testing/aces/v2.0/test/aces:
  File Name                 Size
  ---------                 ----
  docs/                    1,024

languages/ada/ajpo/testing/aces/v2.0/test/aces/docs:
  File Name                 Size
  ---------                 ----
  zc_vddxb.ps            204,003
  zc_vddxd.ps             67,861
  zd_primr.ps            840,581
  zd_primr.txt           192,728
  zd_readg.ps          2,288,410
  zd_readg.txt           564,585
  zd_userg.ps          1,373,446
  zd_userg.txt           326,888
  zd_usrxa.ps             36,074
  zd_usrxa.txt             7,805
  zd_usrxb.ps             22,791
  zd_usrxb.txt             6,679
  zd_usrxc.ps            611,535
  zd_usrxc.txt           188,786
  zd_usrxd.ps             70,214
  zd_usrxd.txt            25,141
  zd_usrxe.ps            142,266
  zd_usrxe.txt            42,782
  zd_usrxf.ps            212,787
  zd_usrxf.txt            72,077
  zd_usrxg.ps             71,874
  zd_usrxg.txt            16,464
  zd_vddoc.ps             61,187
  zd_vddoc.txt            10,695
  zd_vddxa.ps            722,968
  zd_vddxa.txt           442,854
  zd_vddxb.ps            194,662
  zd_vddxb.txt           121,725
  zd_vddxc.ps            253,097
  zd_vddxc.txt            49,138
  zd_vddxd.ps             65,698
  zd_vddxd.txt            24,903
  zd_vddxe.ps             20,797
  zd_vddxe.txt             5,718
  zd_vddxf.ps             33,959
  zd_vddxf.txt            11,900
  zd_vddxg.ps             22,447
  zd_vddxg.txt             5,689
  zd_vddxh.ps             17,484
  zd_vddxh.txt             2,781
  zd_vddxi.ps             14,261
  zd_vddxi.txt             1,241


Totals
  ==============  ==============
  108 Files           22,206,126

ABSTRACT

Ada Compiler Evaluation System (ACES)

The purpose of the ACES is to provide a capability for
quantitative evaluation of Ada compilation systems. The ACES
system is a set of software test programs and associated support
tools and procedures which will determine the performance
characteristics of Ada compilation systems. This includes the
capability to automatically compare the results obtained on
different Ada compilation systems. Such comparisons will isolate
language constructions where one optimization has particular
problems relative to other compilers tested. The ACES will test
for the presence of particular compiler optimization.

ACES was produced as a merger of the Ada Compiler Evaluation Capability
(ACEC) of the United States and the Ada Evaluation System (AES) of
the United Kingdom.  ACES contains over 3500 files, 1700 of which are
compiler performance tests.  Over 1000 pages of documentation is
included as well.  The ACES is not just a test suite -- it defines a
process for evaluating Ada83 compilers and a set of support tools.

The major steps in using the ACES are:
  1. Run the pretest, using the Test harness to generate command
     files for performing the tests
  2. Run a full or partial suite of performance tests
  3. Re-run performance tests selectively, as desired, using the
     Test Harness
  4. Run Analysis Programs using the MENU program

Support for the analysis of the results is through the Single System
Analysis Tool (SSA) and the Comparative Analysis Tool (CA).  The MENU
program manages the execution of the CA and SSA tools as well as a simple
database manager (CONDENSE) and generates reports of the capabilities
analyzed.  Performance of a single compiler can be evaluated, or multiple
compilers can be compared through these tools.

Documentation on the ACES includes a Reader's Guide, a User's Guide,
a Version Description Document, a Product Specification, and
Software Test Plans and Reports.

Many people from several different organizations were involved in the
ACES project, but Boeing had the contract to actually do the merger.
A chronology:
  Jun 1991 - Agreement to merge the ACEC and AES signed by U.S. and U.K.
  Apr 1992 - Merger statement of work completed
  Apr 1992 - Ada/JOVIAL LCF service contract was awarded to CTA, Inc.
  Jul 1992 - CTA, Inc., subcontracts to Boeing to do the merger
  Oct 1992 - Critical Design Review
  Mar 1993 - Formal Qualification Testing
  Apr 1993 - Delivery of ACES to Ada/JOVIAL LCF
  May 1993 - ACES available through Data Analysis Center at Rome AFB
  Sep 1993 - ACES available through the Public Ada Library

People from various organizations who worked on the project included:
  Raymond Szymanski    Dan Roy             Greg Gicca
  Pat Donohoe          Ken Bowles          Neal Altman
  Barbara Rhoads       Bobby Evans         Trudy Grube
  Kim Langdon          Jon Wood            Sam Ashby
  Gerry Masters        Tom Leavitt         Gary McKee
  Kermit Terrell       Dan Eilers          Barbara Decker-Lindsey
  Brad Crawford        Julie Leastman      Jay Ferguson
  Phil Brashear        Dale Lange

                      ACES User Registration

Please register your copy of the Ada Compiler Evaluation System (ACES)
with the DoD Ada Validation Facility (AVF) at Wright-Patterson Air Force
Base.  The AVF is responsible for ACES maintenance and enhancements and
is trying to maintain up to date information on organizations using the
test suite.  ACES users registered with the AVF will be informed of
substantive problem reports, work arounds, and future test suite
version releases.  To register, please contact the DoD AVF at:

    E-mail        langed@adawc.wpafb.af.mil

    FAX           (513) 255-4585

    U.S. mail     ACES
                  645 CCSG/SCSL
                  3810 Communications Blvd
                  Wright-Patterson AFB OH 45433-5707
or
    telephone      (513) 255-4472

Please provide your name, address, phone number, and E-mail address with
your registration.  Thank you for your interest in the ACES!

NOTE: ajpo/aces is a mirror of the ACES distribution maintained by the
Ada Joint Program Office and may be more up to date than swtools/aces


REVISION HISTORY

4 Dec 93  First release to the PAL
Updated by the Ada Information Clearinghouse


RELEASE NOTICE

Approved for public release; distribution unlimited

For information on how to obtain hard copies of these or any other Ada
9X Project Reports, contact the Ada Information Clearinghouse at
800/AdaIC-11 or 703/685-1477.


DISCLAIMER

      This documentation are provided "AS IS" without any expressed or
implied warranties whatsoever.  No warranties as to performance,
merchantability, or fitness for a particular purpose exist.
      The user is advised to review the documentation thoroughly before
relying on it.  The user must assume the entire risk and liability of
using this documentation.  In no event shall any person or organization of
people be held responsible for any direct, indirect, consequential or
inconsequential damages or lost profits.