tests.test_axes.test_symlog failed

Community matplotlib-users
1

I ran the matplotlib.test() and got:
FAILED (KNOWNFAIL=90, errors=14)

I checked more carefully now. It turns out, all the differences are texts.

Most of them are very small differences: Some of them offset to right
and down a little bit. Some of them shrink a little bit. Maybe, it
results from that some fonts in Windows are difference form Linux.

But there is one test gave out very big difference:
the 'tests.test_axes.test_symlog'.
The Y axis tick labels >10 are completely lost.
Please check the attachments.

symlog.png
symlog.png800×600 10.7 KB

expected-symlog.png
expected-symlog.png800×600 13.9 KB

···

#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=
Python: 2.6.5 (r265:79096, Mar 19 2010, 18:02:59) [MSC v.1500 64 bit (AMD64)]
numpy: 1.4.1
matplotlib: 1.0.0
PIL: 1.1.7
#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=#=

FAILED (KNOWNFAIL=90, errors=14)

ERROR: matplotlib.tests.test_axes.test_basic_annotate
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_axes\offset_points.png vs.
D:\works\matplotlibTest\result_images\test_axes\expected-offset_points.png
(RMS 223.063)

======================================================================
ERROR: matplotlib.tests.test_axes.test_fill_units
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_axes\fill_units.png vs.
D:\works\matplotlibTest\result_images\test_axes\expected-fill_units.png
(RMS 58.830)

======================================================================
ERROR: matplotlib.tests.test_axes.test_single_point
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_axes\single_point.png vs.
D:\works\matplotlibTest\result_images\test_axes\expected-single_point.png
(RMS 11.705)

======================================================================
ERROR: matplotlib.tests.test_axes.test_single_date
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_axes\single_date.png vs.
D:\works\matplotlibTest\result_images\test_axes\expected-single_date.png
(RMS 583.302)

======================================================================
ERROR: matplotlib.tests.test_axes.test_shaped_data
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_axes\shaped_data.png vs.
D:\works\matplotlibTest\result_images\test_axes\expected-shaped_data.png
(RMS 823.859)

======================================================================
ERROR: matplotlib.tests.test_axes.test_const_xy
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_axes\const_xy.png vs.
D:\works\matplotlibTest\result_images\test_axes\expected-const_xy.png
(RMS 462.317)

======================================================================
ERROR: matplotlib.tests.test_axes.test_polar_wrap
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_axes\polar_wrap_180.png vs.
D:\works\matplotlibTest\result_images\test_axes\expected-polar_wrap_180.png
(RMS 59.783)

======================================================================
ERROR: matplotlib.tests.test_axes.test_polar_units
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_axes\polar_units.png vs.
D:\works\matplotlibTest\result_images\test_axes\expected-polar_units.png
(RMS 59.557)

======================================================================
ERROR: matplotlib.tests.test_axes.test_polar_rmin
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_axes\polar_rmin.png vs.
D:\works\matplotlibTest\result_images\test_axes\expected-polar_rmin.png
(RMS 40.497)

======================================================================
ERROR: matplotlib.tests.test_axes.test_symlog
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_axes\symlog.png vs.
D:\works\matplotlibTest\result_images\test_axes\expected-symlog.png
(RMS 71.042)

======================================================================
ERROR: matplotlib.tests.test_image.test_image_clip
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_image\image_clip.png vs.
D:\works\matplotlibTest\result_images\test_image\expected-image_clip.png
(RMS 323.003)

======================================================================
ERROR: matplotlib.tests.test_mathtext.test_mathtext
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_mathtext\mathtext.png vs.
D:\works\matplotlibTest\result_images\test_mathtext\expected-mathtext.png
(RMS 41.845)

======================================================================
ERROR: matplotlib.tests.test_mathtext.test_mathtext_stix
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_mathtext\mathtext_stix.png
vs. D:\works\matplotlibTest\result_images\test_mathtext\expected-mathtext_stix.png
(RMS 29.816)

======================================================================
ERROR: matplotlib.tests.test_mathtext.test_mathtext_stixsans
----------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Python26\lib\site-packages\nose-0.11.4-py2.6.egg\nose\case.py",
line 186, in runTest
self.test(*self.arg)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 32, in failer
result = f(*args, **kwargs)
File "C:\Python26\lib\site-packages\matplotlib\testing\decorators.py",
line 126, in decorated_compare_images
'(RMS %(rms).3f)'%err)
ImageComparisonFailure: images not close:
D:\works\matplotlibTest\result_images\test_mathtext\mathtext_stixsans.png
vs. D:\works\matplotlibTest\result_images\test_mathtext\expected-mathtext_stixsans.png
(RMS 21.471)

----------------------------------------------------------------------
Ran 150 tests in 100.386s

2

I ran the matplotlib.test() and got:
FAILED (KNOWNFAIL=90, errors=14)

I checked more carefully now. It turns out, all the differences are texts.

Most of them are very small differences: Some of them offset to right
and down a little bit. Some of them shrink a little bit. Maybe, it
results from that some fonts in Windows are difference form Linux.
   

We don't currently run a Windows-based buildbot for automated tests so we don't tend to catch these differences on a regular basis. The tests use the default fonts that ship with matplotlib, so there should be zero differences between Windows and other platforms (that is, at least, the goal). I'll have a look at these differences next time I'm in front of a Windows box.

But there is one test gave out very big difference:
the 'tests.test_axes.test_symlog'.
The Y axis tick labels>10 are completely lost.
Please check the attachments.
   

Thanks for reporting this. This bug should now be fixed in SVN r8756 (branch) and r8757 (trunk).

Mike

···

On 10/18/2010 05:17 PM, LittleBigBrain wrote:

--
Michael Droettboom
Science Software Branch
Space Telescope Science Institute
Baltimore, Maryland, USA