• rserv1: 6172 (opteron 6100 family, K10 microarchitecture)  4x12cores=48 cores. does not support avx
  
• rserv2: 6272 (amd 15H family. bulldozer  with  interlagos processor core.). 4x16 cores = 64 cores. 128gbMem, supports avx128
• each processor modules has 2cores and 1 fpu unit. The fpu has 2 128bits sets of registers so it can do 2 128bit operations simultaneously (lettting each core run). When the say that they support "avx" they really mean the 128 bit avx instructions that emulate sse4. For true 256 bit operation 1 core has to use all of the fpunit.
  

• AMD compiler options quick reference guide (.pdf)
• for rserv2 used -march=bdver1 -mprefer-avx128 options.
  
• Software optimization guide for amd family 15h processors  (.pdf)
  
• bulldozer cpu (in rserv2). 362 pages
  
• new bulldozer and piledriver instructions (.pdf)
  
• fma,xop,cvt16,bmi,tbb
• The new AMD 6200 series CPU and its relevance to HPC (.pdf)
• AMD 6200 Series processors: Linux Tuning Guide (.pdf)
  
• AMD64 Architecture Programmers Manual:
• Vol 1: Application Programming (.pdf)
•  Vol 2: Systems Programming
• Vol 3: General Purpose and System Instructions
• Vol 4: 128-Bit and 256-Bit Media Instructions (.pdf)
• Vol 5: 64-Bit Media and x87 floating point instructions.
• Surviving and thriving in multi core world (.ps)
  

ACML amd mathlib

• AMD Core Math Library (ACML) version 5.2.0 (.pdf)
• 18feb13- installed /share/megs/phil/x101/amd/amcl/acm5.3.0
• there are different versions for different amd cpus. They are located in subdirectories of the base:
  
• without fma4 instruction (rserv1):
• gfortran64
• gfortran64_mp for use with openmp for multi threaded calls
  
• with fma4 instruction (rserv2)
• gfortran64_fma4
• gfortran64_fma4__mp for use with openmp for multi threaded calls
• we would normally use gfortran64 (rserv1) or gfortran64_fma (rserv2)
• Each version subdirectory contains:
• examples/.
• include/acml.h
• lib/libacm.a,libacml.so (note: i've temporarily renamed the .so to so.save to link with the static version
• To compile, link to the lib use a makefile with (rserv2 example:)
  
• ACMLDIR=/share/megs/phil/x101/amd/acml/acml5.3.0/gfortran64_fma4
• CFLAGS=-I${ACMLDIR}/include -O3  +
• -march=bdver1 .. optimize for bulldozer (rserv2)
  
• -mavx -mprefer-avx128  .. avx and optionally only used 128 bit (sse) versions
• gcc $(CFLAGS) acmlbnch.c -L$(ACMLDIR)/lib -lgfortran -lm -lrt -o acmbnch
• Until rserv2 gets the full gcc install you need:
• scl enable devtoolset-1.1 "gcc xxxxx"