2000 character limit reached
Fast calculation of inverse square root with the use of magic constant $-$ analytical approach (1603.04483v1)
Published 14 Mar 2016 in cs.MS
Abstract: We present a mathematical analysis of transformations used in fast calculation of inverse square root for single-precision floating-point numbers. Optimal values of the so called magic constants are derived in a systematic way, minimizing either absolute or relative errors at subsequent stages of the discussed algorithm.