Opened 10 years ago

Closed 10 years ago

#157 closed defect (fixed)

0.26 ansi-test regressions

Reported by: vvoutilainen Owned by: nobody
Priority: minor Milestone: 0.27
Component: libraries Version:
Keywords: ansi-tests regression Cc:
Parent Tickets:

Description

Diff:

-31 out of 21702 total tests failed:
+36 out of 21702 total tests failed:

(MULTIPLE-VALUE-PROG1.10
DEFGENERIC.ERROR.20
DEFGENERIC.ERROR.21

@@ -14566,8 +14629,9 @@

TYPE-OF.4
CHAR-UPCASE.2
CHAR-DOWNCASE.2

+CHAR-NAME.1

ENSURE-DIRECTORIES-EXIST.8

-PRINT.STRING.RANDOM.1
+PRINT.SYMBOL.RANDOM.2

PRINT.RANDOM-STATE.1
PPRINT-FILL.14
PPRINT-FILL.15

@@ -14576,11 +14640,15 @@

PPRINT-LOGICAL-BLOCK.17
PPRINT-POP.7
PPRINT-POP.8

+FORMAT.C.2A
+FORMATTER.C.2A

FORMAT.LOGICAL-BLOCK.CIRCLE.1
FORMAT.LOGICAL-BLOCK.CIRCLE.2
FORMAT.LOGICAL-BLOCK.CIRCLE.3

+SYNTAX.SHARP-BACKSLASH.6
+SYNTAX.SHARP-BACKSLASH.7

TRACE.8)

Change History (8)

comment:1 Changed 10 years ago by vvoutilainen

These are between 0.25 and trunk. Same diff for 0.25 and the 0.26 branch.

comment:2 Changed 10 years ago by vvoutilainen

Component: compilerlibraries
Owner: changed from ehuelsmann to nobody

comment:3 Changed 10 years ago by Mark Evenson

Results for my regressions run on Solaris using the newly added FULL-REPORT function in ANSI-TESTS (in r13401):

ANSI> (full-report '0.25.0 '0.26.0)

Interpreted
       SATURN-0.25.0       SATURN-0.26.0
         30 failures         33 failures
SATURN-0.25.0:
  (COMPILE-FILE.16 MAKE-PATHNAME.9)
SATURN-0.26.0:
  (SYNTAX.SHARP-BACKSLASH.7 SYNTAX.SHARP-BACKSLASH.6 FORMATTER.C.2A FORMAT.C.2A CHAR-NAME.1)

Compiled
       SATURN-0.25.0       SATURN-0.26.0
         34 failures         35 failures
SATURN-0.25.0:
  (COMPILE-FILE.16 PRINT.STRING.RANDOM.1 PRINT.SYMBOL.RANDOM.2 MAKE-PATHNAME.9)
SATURN-0.26.0:
  (SYNTAX.SHARP-BACKSLASH.7 SYNTAX.SHARP-BACKSLASH.6 FORMATTER.C.2A FORMAT.C.2A CHAR-NAME.1)

comment:4 Changed 10 years ago by Mark Evenson

r13402 fixes SYNTAX.SHARP-BACKSLASH.7 SYNTAX.SHARP-BACKSLASH.6

comment:5 Changed 10 years ago by Mark Evenson

FORMATTER.C.2A bisected to r13256.

comment:6 Changed 10 years ago by Mark Evenson

After r13402, the situation comes down to two additional failing tests, both as a result of r13256:

Interpreted
       SATURN-0.25.0       SATURN-0.26.0
         30 failures         30 failures
SATURN-0.25.0:
  (COMPILE-FILE.16 MAKE-PATHNAME.9)
SATURN-0.26.0:
  (FORMATTER.C.2A FORMAT.C.2A)

Compiled
       SATURN-0.25.0       SATURN-0.26.0
         34 failures         33 failures
SATURN-0.25.0:
  (COMPILE-FILE.16 PRINT.STRING.RANDOM.1 MAKE-PATHNAME.9)
SATURN-0.26.0:
  (FORMATTER.C.2A FORMAT.C.2A)

comment:7 Changed 10 years ago by Mark Evenson

Latest results

(full-report '0.25.0 '0.26.1)

Interpreted
       SATURN-0.25.0       SATURN-0.26.1
         30 failures         20 failures
SATURN-0.25.0:
  (COMPILE-FILE.16 FORMAT.LOGICAL-BLOCK.CIRCLE.3 FORMAT.LOGICAL-BLOCK.CIRCLE.2 FORMAT.LOGICAL-BLOCK.CIRCLE.1 PPRINT-POP.8 PPRINT-POP.7 PPRINT-TABULAR.13 PPRINT-LINEAR.14 PPRINT-FILL.15 PPRINT-FILL.14 MAKE-PATHNAME.9 INVOKE-DEBUGGER.1)
SATURN-0.26.1:
  (FORMATTER.C.2A FORMAT.C.2A)

Compiled
       SATURN-0.25.0       SATURN-0.26.1
         34 failures         21 failures
SATURN-0.25.0:
  (COMPILE-FILE.16 FORMAT.LOGICAL-BLOCK.CIRCLE.3 FORMAT.LOGICAL-BLOCK.CIRCLE.2 FORMAT.LOGICAL-BLOCK.CIRCLE.1 PPRINT-POP.8 PPRINT-POP.7 PPRINT-TABULAR.13 PPRINT-LINEAR.14 PPRINT-FILL.15 PPRINT-FILL.14 PRINT.STRING.RANDOM.1 PRINT.SYMBOL.RANDOM.4 PRINT.SYMBOL.RANDOM.2 MAKE-PATHNAME.9 INVOKE-DEBUGGER.1)
SATURN-0.26.1:
  (FORMATTER.C.2A FORMAT.C.2A)
NIL

comment:8 Changed 10 years ago by Mark Evenson

Resolution: fixed
Status: newclosed

abcl-0.26.1 was released without known regressions.

Note: See TracTickets for help on using tickets.