Convert Function

R

rmace

There is an error in EXCEL 2002 convert function for BTU to flb.

1 BTU should convert to 778 flb; however, it is calculating 25037.

Can someone else confirm this error?

Thank you.
 
V

Vasant Nanavati

I can confirm this error in Excel 2003 as well.
_________________________________________________________________________
 
D

Duke Carey

And in 2007

Vasant Nanavati said:
I can confirm this error in Excel 2003 as well.
_________________________________________________________________________
Click to expand...
 
D

Dana DeLouis

I would just be guessing here.
=CONVERT(1,"btu","flb")
25036.98

In my old "Handbook of Chemistry & Physics"
the closest conversion listed is
Btu to "Foot-Poundals", and listed as 25020.1

Hmmm. Still a little off.

However, if I flip the page, and reverse the conversion, the factor given is
a little less precise...
0.0000399417

but
=1/0.0000399417
returns
25,036.49

Much closer. So, my guess is that Microsoft copied the wrong conversion,
and didn't use enough digits.
 
R

rmace

I have checked several physics and thermodynamic references.
2 of them say 1 BTU = 778 foot pounds.
1 says 1 BTU = 778.3 foot pounds.
1 says 1 BTU = 1060 joules and 1 foot pound = 1.36 joules
which works out to 1 BTU = 779.411 foot pounds.
1 says 1 foot pound = . .001286 BTU
which works out to 1 BTU = 777.605 foot pounds.
A poundal is different than a pound by a factor of the gravitational constant
g = approx 32.2
And the error factor here is approximately = 32.2
Therefore if EXCEL actually meant foot-poundals, instead of foot-pounds,
then there conversion is correct; however, their reference for the convert
function says “foot pounds†and not “foot poundalsâ€. In engineering
practice, “foot-poundals†are seldom used, “foot pounds†are the normal
measurement for energy.

So, maybe, the EXCEL code writers were confused on the units when they wrote
the convert code??

Thank you for your responses. I will send an email to microsoft support.
 
D

Dana DeLouis

Hi. This sure is a confusing conversion.
I learned a little something in a math program.
I was using Foot Pounds, and was flagged with the message "
Incompatible units"

? "SI"
SI[expr] converts expr to SI units (International System)

I had to use the correct unit of Force, and move it 1 foot to get the
conversion.
The newer software version seems to have a logic bug since I had to use
Convert.
SI[BTU/Convert[1*Foot*PoundForce, Joule]]

778.172603790403

If I use "Poundal", I seem to get Excel's conversion factor.

SI[BTU/Convert[Foot*Poundal, Joule]]

25036.945785921285

So, It does appear to me that Excel is using the wrong units of Force.
 
Top