Daniels R. Introduction to Numerical Methods and Optimization Techniques 1978

Textbook in PDF format

This book's philosophy differs from most others written on numerical methods or numerical analysis. In a typical numerical-analysis text, much time is spent on error analysis. However, in practical applications, usually little time is devoted to rigorous error analysis.
Instead of relying solely on error analysis to estimate the accuracy of answers, other methods are emphasized in this text. Observing how a process converges can give insight into its accuracy. Also, solving a problem two different ways can verify a solution. Although error analysis
is not very practical as a tool for estimating accuracy, it does have other uses. It can be used to compare different numerical methods and demonstrate that, on the average, one is superior to another. Or a knowledge of error properties can be used to improve a numerical method.
Avoiding a lengthy investigation of error analysis allows time for the reader to become acquainted with optimization techniques. Numerical methods and optimization techniques are intimately related, but unfortunately they are not generally taught in the same course. However, since both numerical methods and optimization techniques are usually iterative procedures, they have a common philosophy and application. In fact, as demonstrated in this book, an optimization technique can be viewed as a collection of numerical methods which have been linked together in a specific way. Thus, once a student has become familiar with numerical methods the extension to optimization techniques is very natural.
This text does not attempt to be a complete catalog of numerical methods or optimization techniques-volumes would be needed for this. For a specific problem, the specialist can probably consult the literature and obtain a more efficient solution than presented in this book. If he uses his sophisticated program very often, his time is well spent. In fact, this text is not written for the specialist, but for the reader or student who will probably not have the luxury of spending days on research to save milliseconds of computer time