Record of Known Bugs
Tests that are Wrong or have Parse Errors
38 Incorrect RC6 testcases
Tests relying on non-normative behavior
-
Various [min-|max-|]height-applies-to- tests listed here : height, max-height, min-height supposed to be undefined for table row groups; max-height and min-height should not apply to table-row elements and table-cell elements - Some fixed in RC4 remaining fixes in RC5
-
-
[MSFT]
[RC6] font-005 , [MSFT]
[RC6] font-019 and [MSFT]
[RC6] font-021: all 3 testcases assume that synthetic small-caps “x” must be taller/larger than normal lowercase “x” when the
spec makes no statement of this sort. Also, using x/X is not best; better is e/E because glyphs have different shapes.
More info
-
[MSFT]
[RC6] first-letter-selector-015 Konqueror 4.6.4 fails this test only because a missing image icon is shown and
the text “Missing” is shown (due to default image placeholder dimensions insufficient, too narrow, for the alt text) but
not “Missing image”. Just because of that, I think the testcase should be reviewed.
Miscellaneous incorrect tests
0 RC4 testcase with incorrect pass condition / dependence on font metrics
92 RC6 testcases not actually testing what they are supposed to test or that are too easy to pass
11 invalid RC6 testcases because they rely on rounding issues
Tests that need Usability improvements
Ugly, not self-documenting:
background-alpha-001
background-alpha-002
background-alpha-003
background-alpha-004
background-alpha-005
[MSFT] [RC6] content-158 What to do? set display: inline-block to containing block and then a padding of 1em should be added to make viewing easier, faster.
Confusing/hard to judge
background-attachment-004 (also has external references to image files)
inlines-004-inlines-006: unclear what “aligned” means. Fixed for RC4
text-transform-bicameral-009, text-transform-bicameral-010: should attempt to pick a font that has the glyphs - Uses the browser's default, which should be falling back to whatever it can find.
[MSFT]
[RC6] background-130 - still not fixed in RC6: “on top of” should be replaced with “above”; “stripe” seems preferable to “short box”
-
-
-
-
[Hixie]
[RC6] inline-block-002 since “Try resizing the window so that inline-blocks wrap in one or two columns.” can never be accomplished. It should be saying instead/rather something like “Try resizing the window so that inline-blocks
wrap internally into 2 lines of text.”
[Hixie]
[RC6] inline-block-004 since “Try resizing the window so that inline-blocks wrap in one or two columns.” can never be accomplished. It should be saying instead/rather something like “Try resizing the window so that inline-blocks
wrap internally into 2 lines of text.”
[Hixie]
[RC6] inline-block-005 since “Try resizing the window so that inline-blocks wrap in one or two columns.” can never be accomplished. It should be saying instead/rather something like “Try resizing the window so that inline-blocks
wrap internally into 2 lines of text.”
[Hixie]
[RC6] first-line-pseudo-017 says “This line should be green.” but it is its background color.
Proposed correction: “This line should have a green background.”
[Hixie]
[RC6] first-line-pseudo-018 says “This line should be green.” but it is its text.
Proposed correction: “This text should be green.”
[Hixie]
[RC6] hover-selector-002 says “When you hover over this text (…)” : the
this word normally is self-pointing, self-referencing… but not in this test. Such formulation is confusing.
9 RC6 testcases with too technical pass conditions
-
[Hixie]
[RC6] background-alpha-001 My neighbour would ask “What's a 'multi-bit alpha channel'?” Pass conditions are not so clear and text is too technical.
[Hixie]
[RC6] background-alpha-002 My neighbour would ask “What's a 'multi-bit alpha channel'?” Pass conditions are not so clear and text is too technical.
[Hixie]
[RC6] background-alpha-003 My neighbour would ask “What's a square div? How tall/big is/should be the 'size of two tiles'?” Pass conditions are not clear or easy for normal people and text is too technical.
[MSFT]
[RC6] cursor-applies-to-005 My neighbour would ask “What's a default cursor? How does it look like?” I propose to add to the expected results: “The default cursor often looks like an arrow.”
[MSFT]
[RC6] cursor-applies-to-006 My neighbour would ask “What's a default cursor? How does it look like?” I propose to add to the expected results: “The default cursor often looks like an arrow.”
[Hixie]
[RC6] first-line-pseudo-011 The pass conditions text should be only: “The next three boxes should look identical.” The sentence “(If the second and third look different, then margin collapsing through empty elements is broken. Go to these tests for more details.)” should be removed.
-
-
[Hixie]
c527-font-000 : “There should be a small gap between each line.”
Reason: how small is “a small gap”? How can a normal tester (your mother, your bus driver, your neighbour) realistically establish that this gap here is small while that gap over there is not small? How exactly can this test fail?
[Hixie]
c527-font-002 : “9px gap between lines”
Reason: how can a normal tester (your mother, your bus driver, your neighbour) realistically establish that this gap here is 9px while that gap over there is not 9px? The testcase does not provide a ruler, some kind of green overlapping red mechanism, etc. Where is the start line and the end line?
[Hixie]
c527-font-003 : “small and cursive, with double line spacing”
Reason: it is not clear how such test can be evaluated as pass or fail, even by a machine.
-
-
-
-
-
-
[Hixie]
c527-font-10 :
Reasons: All these testcases rely on the tester being able to measure a distance of a few pixels between lines, or the font-size, without a comparing ruler, without a reliable working measurement system or some kind of overlapping color mechanism.
More explanations on why these c527-font-* testcases need to be reworked or redesigned to be easier for normal tester-persons to evaluate: http://lists.w3.org/Archives/Public/public-css-testsuite/2010Jan/0043.html , http://lists.w3.org/Archives/Public/public-css-testsuite/2010Aug/0000.html , http://lists.w3.org/Archives/Public/public-css-testsuite/2010Oct/0061.html
Should be ref tests
[Hixie]
[RC6] vertical-align-121 Removing
<p class=“ahemprereq”>
whole paragraph is likely going to remove the unneeded and unexpected horizontal scrollbar at the same time.
[Hixie]
[RC6] white-space-collapsing-001 Removing
<div class=“prereq”>
whole paragraph is likely going to remove the unneeded and unexpected horizontal scrollbar at the same time.
[Hixie]
[RC6] white-space-collapsing-002 Removing
<div class=“prereq”>
whole paragraph is likely going to remove the unneeded and unexpected horizontal scrollbar at the same time.
0 RC6 testcase without pass conditions
8 RC6 testcases with some linkage/link issue
0 RC6 testcase that rely on unnecessary assumptions
Tests that have HTML or CSS Validation errors
9 testcases that have HTML Validation errors
6 RC6 testcases that have CSS Validation errors
3 testcases with wrong, incorrect meta assert text
0 RC6 testcase possibly missing http flag
1 RC6 testcase missing the paged flag
7 RC6 testcases missing the ahem flag
73 RC6 testcases missing the invalid flag
-
-
-
-
-
-
-
-
[MSFT]
[RC6] max-height-001: because “Negative values for 'min-height' and 'max-height' are illegal.”
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
[MSFT]
[RC6] min-height-001: because “Negative values for 'min-height' and 'max-height' are illegal.”
-
-
-
-
-
-
-
[MSFT]
[RC6] min-width-001: because “Negative values for 'min-width' and 'max-width' are illegal.”
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
1 RC6 testcase missing the interact flag
[Hixie]
[RC6] floats-110 since resizing the viewport is part of the test pass/fail condition
0 RC6 testcase missing the dom flag
0 RC6 testcase with some coding issues
3 RC4 testcases using, relying on CSS3 grammar or CSS3 properties
page-break-after-010 relies on CSS3 at-keywords for paged media - CSS3 bits not part of tests, so ok
-
-
0 RC6 test with missing title
2 RC4 testcases which could render a missing image icon as acceptable handling of url(missing-image.png)
RC5 test cases with font rounding issues
-
orphans-00*
widows-00*
Also any “paged” test cases
General Issues