Table of Contents
Question content
Workaround
Home Backend Development Golang Go: How to check precision loss when converting float64 to float32

Go: How to check precision loss when converting float64 to float32

Feb 09, 2024 am 09:10 AM

Go:如何检查将 float64 转换为 float32 时的精度损失

php editor Baicao today introduces to you a solution to a common problem: how to check the precision loss that may occur when converting float64 to float32. When converting floating point numbers, precision loss may occur due to the difference in the number of bits between the two data types. This article will detail how to determine whether there is a loss by comparing the values ​​before and after conversion, and provide a feasible solution to help developers better deal with this problem.

Question content

I have a scenario where I receive a float64 value but have to send it over the wire to another service as a float32 value. We know that the received value should always fit into a float32. However, just to be on the safe side I'd like to log that we lose data by converting to float32.

This code block will not compile because you cannot compare float32 to float64 directly.

func convert(input float64) (output float32, err error) {
    const tolerance = 0.001
    output = float32(input)
    if output > input+tolerance || output < input-tolerance {
        return 0, errors.New("lost too much precision")
    }
    return output, nil
}
Copy after login

Is there an easy way to check if I'm encountering this? This check happens frequently, so I want to avoid string conversion.

Workaround

You can convert the float32 value back to float64, for validation only.

To check if the converted value represents the same value, just compare it with the original value (input). It is also sufficient/idiomatic to just return the ok bool message (instead of error):

func convert(input float64) (output float32, ok bool) {
    output = float32(input)
    ok = float64(output) == input
    return
}
Copy after login

(Note: Edge cases like nan will not be checked.)

Test it:

fmt.println(convert(1))
fmt.println(convert(1.5))
fmt.println(convert(0.123456789))
fmt.println(convert(math.maxfloat32))
Copy after login

Output (try it on go playground):

1 true
1.5 true
0.12345679 false
3.4028235e+38 true
Copy after login

Note that this will usually give ok = false results, since float32 has less precision than float64, even though the converted value may be very close to the input .

So it would be more useful in practice to check the difference in converted values. Your proposed solution checks for absolute differences, which is not very useful: e.g. 1000000.1 and 1000000 are very close numbers, even if the difference is 0.1. The difference between 0.0001 and 0.00011 is much smaller: 0.00001, but the difference is much larger compared to the numbers.

So you should check the relative difference, for example:

func convert(input float64) (output float32, ok bool) {
    const maxreldiff = 1e-8

    output = float32(input)
    diff := math.abs(float64(output) - input)
    ok = diff <= math.abs(input)*maxreldiff

    return
}
Copy after login

Test it:

fmt.println(convert(1))
fmt.println(convert(1.5))
fmt.println(convert(1e20))
fmt.println(convert(math.pi))
fmt.println(convert(0.123456789))
fmt.println(convert(math.maxfloat32))
Copy after login

Output (try it on go playground):

1 true
1.5 true
1e+20 false
3.1415927 false
0.12345679 false
3.4028235e+38 true
Copy after login

The above is the detailed content of Go: How to check precision loss when converting float64 to float32. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Roblox: Bubble Gum Simulator Infinity - How To Get And Use Royal Keys
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
Nordhold: Fusion System, Explained
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
Mandragora: Whispers Of The Witch Tree - How To Unlock The Grappling Hook
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Hot Topics

Java Tutorial
1666
14
PHP Tutorial
1273
29
C# Tutorial
1255
24
Golang vs. Python: Performance and Scalability Golang vs. Python: Performance and Scalability Apr 19, 2025 am 12:18 AM

Golang is better than Python in terms of performance and scalability. 1) Golang's compilation-type characteristics and efficient concurrency model make it perform well in high concurrency scenarios. 2) Python, as an interpreted language, executes slowly, but can optimize performance through tools such as Cython.

Golang and C  : Concurrency vs. Raw Speed Golang and C : Concurrency vs. Raw Speed Apr 21, 2025 am 12:16 AM

Golang is better than C in concurrency, while C is better than Golang in raw speed. 1) Golang achieves efficient concurrency through goroutine and channel, which is suitable for handling a large number of concurrent tasks. 2)C Through compiler optimization and standard library, it provides high performance close to hardware, suitable for applications that require extreme optimization.

Getting Started with Go: A Beginner's Guide Getting Started with Go: A Beginner's Guide Apr 26, 2025 am 12:21 AM

Goisidealforbeginnersandsuitableforcloudandnetworkservicesduetoitssimplicity,efficiency,andconcurrencyfeatures.1)InstallGofromtheofficialwebsiteandverifywith'goversion'.2)Createandrunyourfirstprogramwith'gorunhello.go'.3)Exploreconcurrencyusinggorout

Golang vs. C  : Performance and Speed Comparison Golang vs. C : Performance and Speed Comparison Apr 21, 2025 am 12:13 AM

Golang is suitable for rapid development and concurrent scenarios, and C is suitable for scenarios where extreme performance and low-level control are required. 1) Golang improves performance through garbage collection and concurrency mechanisms, and is suitable for high-concurrency Web service development. 2) C achieves the ultimate performance through manual memory management and compiler optimization, and is suitable for embedded system development.

Golang's Impact: Speed, Efficiency, and Simplicity Golang's Impact: Speed, Efficiency, and Simplicity Apr 14, 2025 am 12:11 AM

Goimpactsdevelopmentpositivelythroughspeed,efficiency,andsimplicity.1)Speed:Gocompilesquicklyandrunsefficiently,idealforlargeprojects.2)Efficiency:Itscomprehensivestandardlibraryreducesexternaldependencies,enhancingdevelopmentefficiency.3)Simplicity:

C   and Golang: When Performance is Crucial C and Golang: When Performance is Crucial Apr 13, 2025 am 12:11 AM

C is more suitable for scenarios where direct control of hardware resources and high performance optimization is required, while Golang is more suitable for scenarios where rapid development and high concurrency processing are required. 1.C's advantage lies in its close to hardware characteristics and high optimization capabilities, which are suitable for high-performance needs such as game development. 2.Golang's advantage lies in its concise syntax and natural concurrency support, which is suitable for high concurrency service development.

Golang vs. Python: Key Differences and Similarities Golang vs. Python: Key Differences and Similarities Apr 17, 2025 am 12:15 AM

Golang and Python each have their own advantages: Golang is suitable for high performance and concurrent programming, while Python is suitable for data science and web development. Golang is known for its concurrency model and efficient performance, while Python is known for its concise syntax and rich library ecosystem.

Golang and C  : The Trade-offs in Performance Golang and C : The Trade-offs in Performance Apr 17, 2025 am 12:18 AM

The performance differences between Golang and C are mainly reflected in memory management, compilation optimization and runtime efficiency. 1) Golang's garbage collection mechanism is convenient but may affect performance, 2) C's manual memory management and compiler optimization are more efficient in recursive computing.

See all articles