problem with small y-axis scale

I get strange "histogram-like" plots if the y-axes scale is

    > some orders of magnitude smaller than the x-axis (latest
    > svn version).

This appears to be a truncation error due to the formating string we
use to represent floats in backend_ps. Darren, should we prefer 1.3e
instead of 1.3f, or perhaps 1.4e or 1.5e?

JDH

John Hunter wrote:

"Steve" == Steve Schmerler <elcorto@...361...> writes:

    > I get strange "histogram-like" plots if the y-axes scale is
    > some orders of magnitude smaller than the x-axis (latest
    > svn version).

This appears to be a truncation error due to the formating string we
use to represent floats in backend_ps. Darren, should we prefer 1.3e
instead of 1.3f, or perhaps 1.4e or 1.5e?

John, Darren,

I would suggest something like 1.5g, which will be less bulky for common cases than 1.5f.

Matlab ps files have all paths already transformed to paper coordinates but in very small units (thousandths of an inch?) so that they can be given as integers.

Eric

John Hunter wrote:

"Steve" == Steve Schmerler <elcorto@...361...> writes:

    > I get strange "histogram-like" plots if the y-axes scale is
    > some orders of magnitude smaller than the x-axis (latest
    > svn version).

This appears to be a truncation error due to the formating string we
use to represent floats in backend_ps. Darren, should we prefer 1.3e
instead of 1.3f, or perhaps 1.4e or 1.5e?

Replacing %f by %e and %1.3f by %1.5e in the latest svn version's backend_ps.py solves the problem.

cheers,
steve

···

--
Random number generation is the art of producing pure gibberish as quickly as possible.

I think 1.4g is the way to go. It's fixed in svn 2252.

···

On Sunday 02 April 2006 22:55, John Hunter wrote:

    > I get strange "histogram-like" plots if the y-axes scale is
    > some orders of magnitude smaller than the x-axis (latest
    > svn version).

This appears to be a truncation error due to the formating string we
use to represent floats in backend_ps. Darren, should we prefer 1.3e
instead of 1.3f, or perhaps 1.4e or 1.5e?

JDH

-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live
webcast and join the prime developer group breaking into this new coding
territory!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642
_______________________________________________
Matplotlib-users mailing list
Matplotlib-users@lists.sourceforge.net
matplotlib-users List Signup and Options

--
Darren S. Dale, Ph.D.
Cornell High Energy Synchrotron Source
Cornell University
200L Wilson Lab
Rt. 366 & Pine Tree Road
Ithaca, NY 14853

dd55@...163...
office: (607) 255-9894
fax: (607) 255-9001