search for: decimal

Displaying 20 results from an estimated 1824 matches for "decimal".

2016 Aug 23
2
How to describe the RegisterInfo?
Yes, the arch is just as you said, something like AMD GPU, but Intel GPU don't have separate register file for 'scalar/vector'. In fact my idea of defining the register tuples was borrowed from SIRegisterInfo.td in AMD GPU. But seems that AMD GPU mainly support i32/i64 register type, while Intel GPU also support byte/short register type. So I have to start defining the registers from
2010 Oct 20
4
Changing sign on absolute numbers 0 problems
Hi, I am trying to do some calculations turning DMS data to decimal degrees using the formula (D+(M/60)+(S/3600)), some of the D's involve -ve numbers, the easiest way to do the calculation is to use absolute numbers then use the 'sign' function in R to change the answer back to the correct -ve or +ve, for example, if; D<--69 M<-8 S<-10 the...
2006 Apr 11
2
Schema.rb and MySQL decimal
Hi, I have a mysql schema with some decimal(20,20) fields. Now, I made a rake db_schema_dump for deployment of my applications on other machines. Rails created a schema.rb with the decimal fields as float. After a rake db_schema_import the fields are just float not decimal. How can I force rails to create decimal(20,20) columns instead of...
2006 Feb 23
3
Decimal comma instead of decimal point (i18n issue)
Hello, What is the easiest way which enables usage of decimal comma "," instead of decimal point (".") . I would like to force all RoR views to display float numbers with comma instead of decimal point and also to allow insertion of float numbers with comma in forms. Thanks in advance, Karel -- Posted via http://www.ruby-forum.com/.
2006 May 04
3
Decimal
Can someone please tell me the best approach to adding support for editing MySQL decimal types in rails? I have a field in the DB that represents currency, and the view will not let save anything past the decimal place so, 10.99 becomes 10.00 automatically. Any help is appreciated. -- Posted via http://www.ruby-forum.com/.
2003 Aug 13
7
Regexpr with "."
I'm trying to use the regexpr function to locate the decimal in a character string. Regardless of the position of the decimal, the function returns 1. For example, > regexpr(".", "Female.Alabama") [1] 1 attr(,"match.length") [1] 1 In trying to figure out what was going on here, I tried the below command: > gsub("....
2007 Nov 13
4
question about activerecord test_numeric_fields in base_test.rb
There''s a test for activerecord called test_numeric_fields in base_test.rb. here''s the test def test_numeric_fields m = NumericData.new( :bank_balance => 1586.43, :big_bank_balance => BigDecimal("1000234000567.95"), :world_population => 6000000000, :my_house_population => 3 ) assert m.save m1 = NumericData.find(m.id) assert_not_nil m1 # As with migration_test.rb, we should make world_population >= 2**62 # to cover 64-bit platforms an...
2007 Sep 23
2
Plotting numbers at a specified decimal length on a plot()
Hi there, I want to figure out how to plot means, with 2 decimal places, of any Y variable on a scatterplot according to any X variable (which obviously should have limited scope). I already figured out how to plot the means, but without limiting their precision to 2 decimal places. This is the code I used once I had the scatterplot drawn: text(c(1990, 19...
2006 Dec 09
2
Floating point maths in R
...be true [1] FALSE > (4.230-2.230)==2.000 <------- should be true [1] FALSE > (4.230-2.230)==2.00 <------- should be true [1] FALSE > (4.230-2.23)==2.00 <------- should be true [1] FALSE I have tried these on both 64 and 32-bit machines. Surely R should be able to do maths to 2 decimal places and be able to test these simple expressions? The problem occurs as in the 16th decimal place junk is being placed by the FPU it seems. I have also tried: > (4.2300000000000000-2.230000000000000) == 2 [1] FALSE > a <- (4.2300000000000000-2.230000000000000) > a == 2 [1] FAL...
2008 Jan 19
1
Decimals are being converted to Bigdecimals!!!!!
Hi all, I''m working on a financial app, and have set up some columns in my tables as decimals with precision => 8 and scale => 2. My migration looks like: change_column :lineitems, :price, :decimal, :precision => 8, :scale => 2 change_column :payments, :amount, :decimal, :precision => 8, :scale => 2 I''ve run the migration and restarted the server. I al...
2006 Jun 08
7
The Agile Book Messageboard?
Hello. Where is there an Agile Messageboard? On the first part of the Depot example, a price field shouldn''t be an integer right? (it should be more of a float since a price has decimals) Dominic Son -- Posted via http://www.ruby-forum.com/.
2011 Jan 14
2
read in data, maintain decimal places
Good day, All, Is there any way to maintain the number of decimal places in the type of situation below? I would like to maintain the number of decimal places in 0.667, despite the fact that its column-mates have a fourth decimal place. Thank you for your time. Jim dat.txt contents: MARKER ALLELES FREQ1 RSQR EFFECT2 STDERR CHISQ...
2009 Mar 18
4
[LLVMdev] decimal to floating point conversion
Hi all: I need an instruction that can convert decimal values into floating point numbers. i.e. say I have a decimal number 1110794174 (== 42355FBE in hex ) and (== 45.3435 as a float) essentially the mantissa and exponent representation needs to be used. Is there any way of doing this in llvm? Thanks and Regards -- -- Aparna Kotha Graduate...
2006 Jun 30
4
always show 2 decimal places
Hi, I have a float that often looks like somthing like 2003.2 in my controller (1 decimal place) Is there a way to always show it to 2 decimal places eg 2003.20 ? Thanks Scott -- Posted via http://www.ruby-forum.com/.
2012 Oct 26
2
Number of decimal places
When estimating values ??each determined similarly, and in which get to them by algebraic operations in some cases, are rounded with 0 decimal places and in other cases with 2 or 3 decimal places. What is happening? Thank you. -- View this message in context: http://r.789695.n4.nabble.com/Number-of-decimal-places-tp4647549.html Sent from the R help mailing list archive at Nabble.com.
2003 Mar 14
2
numbers and decimal points
I have a question for our European readers: how common is it to use commas as decimal points in spread-sheet and statistics applications? Is it an inconvenience to require that all data use a period as decimal point? (i.e., 3.14159 rather than 3,14159). We're trying to make our program as foolproof as possible, and would prefer not to give users a chance to have commas as both...
2009 May 12
4
decimal troubles ?
Dear all, I have some trouble with the number of decimals in R (currently R 2.9.0). For instance: > options()$digits [1] 3 let me hope that I will get three digits where useful when a number is printed. BUT: > 44.25+31.1+50 [1] 125 No way to get the right result 125.35 Can anybody tell me what's happens ? Patrick
2009 May 14
2
specify the number of decimal numbers
Hi, I was wondering how to specify the number of decimal numbers in my computation using R? I have too many decimal numbers for my result, when I convert them to string with as.character, the string will be too long. Thanks and regards! -- View this message in context: http://www.nabble.com/specify-the-number-of-decimal-numbers-tp23538852p23538852.html...
2006 Feb 13
2
R-help, specifying the places to decimal
Hello - R-experts, Is there any way with which we can specify the number after decimal point to take. Like I have a situation where the values are comming 0.160325923 but I only want 4 place to decimal say 0.1603. Is there any way for that. I am no expert in R- and this may sound simple to many.sorry Thanks for any help. With Regards Subhabrata
2007 Sep 16
8
Rounding up to two decimal places
Hi there I am going to calculate VAT at one of my websites, and UK VAT is 17.5 %. So the question is how to round up some value to two decimal points? I often get values like 6,991.. In php I was using round function round($price, 2) is in ruby something similat to PHP''s round function where I could specify number of decimal places ? P. --~--~---------~--~----~------------~-------~--~----~ You received this message because...