Jump to content

Flattern to XML - rounding


Recommended Posts

Hi all,

My problem with Flattern to XML is rounding, see following example.

DBL 0.123456789

result:

<DBL>

<Name>Value</Name>

<Val>0.12346</Val>

</DBL>

Is there any way to set precision of conversion? BTW conversion back (unflattern) works just fine.

Thanks&Regards,

David

Link to comment

Hi all,

My problem with Flattern to XML is rounding, see following example.

DBL 0.123456789

result:

<DBL>

<Name>Value</Name>

<Val>0.12346</Val>

</DBL>

Is there any way to set precision of conversion? BTW conversion back (unflattern) works just fine.

Thanks&Regards,

David

I just tried this on my system (LV 8.6.1) and passed a double control into the Flatten To XML function and got

<DBL>

<Name>Value</Name>

<Val>0.12345678900000</Val>

</DBL>

which preserves the precision of the double - In LV 8.5.1 I get the results you describe. I thought I remembered something about Flatten To XML having some bugs fixed lately. So, if you can, upgrade to 8.6 ;)

Mark

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Unfortunately, your content contains terms that we do not allow. Please edit your content to remove the highlighted words below.
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.