Objectives: I am an experienced software engineer and have interest in both algorithms and performance. Mastering hardware architectures and OS internals, I am able to grasp software systems as whole and pay attention to performance of critical components. Currently I work for various scientific projects helping to improve performance.



Suren A. Chilingaryan, PhD
(Download PDF)

E-mail: csa@suren.me
Jabber: csa@suren.me
Phone: +49 176 438-53094

Maintained Software:
http://suren.me/projects/

Public Profiles:
LinkedinResearchGateGoogle Scholar

Expertise:

A. Engineering distributed data acquisition and control systems;
B. Designing software components and distributed software architectures;
C. System programming and development of PCIe drivers;
D. Performance analysis and software optimization techniques;
E. Parallel programming and parallel hardware architectures;
F. Low-latency communication in heterogeneous systems;
G. Cloud-based data management and visualization;
H. Automation of system management and administration;
I. Web technologies;
J. Technical writting.

Skills:

Operating Systems: Linux, FreeBSD, Open Solaris, Windows family;
Orchestration: Ansible, OpenShift, Docker, LibVirt/KVM, Infiniband, GlusterFS;
Programming Languages: C/C++, Ruby, Perl, Python;
Parallel Programming: CUDA/OpenCL, SSE/AltiVec, OpenMP/NPTL, IPC;
Performance Analysis: gdb, perf/operf, nvvp/nvprof, vtune, valgrind, systap, tcpdump;
System Programming: POSIX/WINAPI, Linux Internals, PCI Drivers, DMA, GPUDirect/DirectGMA;
Scientific Computing: MATLAB, ROOT, BLAS/LAPACK;
Network Programming: TCP/IP, RDMA, MPI, Web Services, CORBA, OBEX, Apache Modules;
Web Technologies: PhP, XML (DOM, SAX, XSLT, XSD), HTML5, JavaScript;
Databases: MySQL, MSSQL, OpenLDAP, BerkeleyDB, SQL;
UI Development: GTK, QT, Curses, XForms, Internationalization.

Professional Experience:

2007-present:

Data Processing Expert at Karlsruhe Institute of Technology

  • Engineering data acquisition and control systems for high-speed detectors and detector networks
    • Participated in a case-study aimed to evaluate possibility to use GPUs in L1 track trigger for the next upgrade of CMS experiment. A GPU-based trigger prototype were developed. It uses GPUDirect and DirectGMA technologies to distribute the track candidates from FPGA-based electronics to multiple GPUs which reconstruct tracks and signal FPGA if the track is accepted. The target latency of 6 us was achieved using the GPUDirect variant, but the data throughput was considered unacceptable for practical utilization. More Info
    • In 2011 - 2017 I was responsible for the software stack of UFO (Ultra fast X-ray computer tomography) project. We designed a new type of control system for synchrotron beamline which is aimed for high-speed 3D and time-resolved 4D imaging and enabling image-based feedback loops. I also designed a scalable architecture for UFO control system combining readout, computation, and storage nodes using Infiniband fabric. More Info
    • Designed a Linux kernel framework aimed to help hardware engineers with rapid prototyping of drivers for high bandwidth PCIe-based electronics. It provides flexible XML-based register model with scripting support, modular scatter-gather DMA engines, and low-latency RDMA communication with GPUs. Developed the Linux driver for in house built high performance camera with external PCI express interface (2MPix at 300 fps). Designed control applications for several high-speed cameras connected with PCIe and CameraLink interfaces.
    • Maintain parts of slow control system for KATRIN (KArlsruhe TRItium Neutrino) experiment. Developed the middleware to interconnect subsystems based on different control platforms using OPC DA interface and Web Services.

Used Technologies: C, POSIX, Linux Kernel Modules, DMA, GPUDirect/DirectGMA, Linux AIO, iSCSI/iSER, GlusterFS, Ruby/Python, LabVIEW, WinCC, OPC, Web Services


  • Performance analysis and optimization of data/image processing software
    • Made a comparative study of major parallel architectures using micro-benchmarking techniques. Based on the architecture analysis, developed 3 modifications of back-projection algorithm optimized for a range of NVIDIA, AMD, and Intel architectures. The implementations balance the load between Texture engine, Core units, and SFUs to also utilize multiple types of hardware resources in parallel.
    • Supervised development of algorithms and parallel software facilitating tracking of fluorescent nanoparticles in 3D and with subnanometer precision. Open Source
    • In collaboration with ESRF developed a CUDA version of PyHST, a software package for synchrotron tomography. Fast parallel implementations of FBP and DFI algorithms were developed. Open Source
    • Optimized and parallelized a Matlab implementation of Digital Image Correlation and Tracking algorithm used for strain measurements in material science. Open Source
    • Optimized MRSES (Multiple Random Searches with Early Stop), a feature selection algorithm, to run on the IBM CELL architecture. Open Source

Used Technologies: Algorithms, C/C++, Ruby, Python, Octave / Matlab, CUDA / OpenCL, SIMD (SSE / AltiVec), Linux Kernel Modules, DMA


  • Development of data management platforms
    • Developed a scalable platform to explore, manage, and visualize large archives of time series data. It includes a data abstraction layer to integrate data written in different formats, stored in a variety of database engines, and recorded with the varying sampling rates. RESTful API enables integration with the rest of the experiment instrumentation. The multi-level cache hierarchy enables interactive response also for very large archives. Depending on the expected data rates, the platform is either running on a standalone server or deployed in RedHat's OpenShift cloud platform. Open Source
    • Supervise development of web-based 3D visualization platform for data archives storing large tomographic volumes.
    • Working on slow control systems for the KATRIN (KAtrin TRItium Netrino) experiment, a coil test facility at TOSKA (Testfacility for Fusion Magnets), and a KIT-Cube project aimed to atmospheric studies.
    • Integrated NI LabVIEW based slow control subsystem with Siemens WinCC control system using OPC DA interface. Extended control system with a remote control capabilities based on Web Services.

Used Technologies: OpenShift, Ansible, GlusterFS, PhP, JavaScript, WebGL, MSSQL, MySQL, National Instruments LabVIEW, Siemens WinCC, ROOT

2005-2007:

Software Engineer at Yerevan Physics Institute

  • Participated in the design of infrastructure of the DAQ system for ASEC (Aragats Space Environmental Center) and SEVAN (Space Environmental Viewing and Analysis Network) cosmic ray detector networks.
  • Develop a middleware and web frontend for the DAQ system at ASEC. The uniform access to the various electronics connected over USB, Serial and Ethernet interfaces is provided. Data acquisition is performed in automatic fashion in background. Electronics monitoring and control is feasible using web interface.
  • Develop the microcode for the microprocessors controlling operation of the detectors.

Used Technologies: C, Portable Programming, POSIX, WINAPI, Network programming, Process Synchronization, AJAX, XML technologies, Programming of Fujitsu MB9136x and Phillips LPC21xx (ARM7) microcontrollers.

2002-2005:

Associate Researcher at Forschunszentrum Karlsruhe

  • Designed a set of extensions to the OPC XML-DA protocol facilitating it's usage in the high performance systems.
  • Implemented an abstraction library hiding details of operational system. On top of it implemented a multi-platform OPC XML-DA library and an experimental server.
  • Developed OPC XML-DA bindings for National Instruments LabVIEW.
  • Developed PHP OPC XML-DA client providing ability to represent control data by means of the standard web interface.

Used Technologies: C, Portable Programming, POSIX, WINAPI, Process Synchronization, CORBA, Apache module programming, Sockets, XML technologies, Web Services, NI LabVIEW, PHP.

2001-2002:

Software Engineer at Yerevan Physics Institute

  • Developed a web interface for facilitating centralized management of the department servers and workstations. Interface allows managing users (personal information, permissions), computers (DNS, DHCP, remote booting) and employee assigned tasks.
  • Developed a web based X509 certificate authority management.
  • Developed a readout software for scientific equipment controlling cosmic ray detectors.

Used Technologies: C, Perl, PHP, LDAP, X509

1999-2000:

Internship at Forschungszentrum Karlsruhe

  • Developed a Linux driver for the SAND PCI neuro-acceleration board.
  • Implemented a neural network learning framework on top of that driver.

Used Technologies: C/C++, Linux Driver Development, Neural Networks, GTK+

2001-present:

Maintained Free Projects

  • RusXMMS project is a library for automatic language/encoding detection and conversion. Patches for popular Linux music players, FTP clients and a few other applications are provided.
  • XML Benchmark is benchmarking suite for performance comparison of various C/C++/Java XML toolkits. It measures performance in multiple fields including DOM, SAX, and PULL, various manipulations with DOM trees, validation against XSD Schema, XSL Transformation, and XML Security.
  • PAM module for system authentication using Bluetooth enabled mobile phones over OBEX protocol.
  • Simple Flash Menu is a Macromedia Flash application aimed to generate complex hierarchical menus basing on the supported XML file.

Used Technologies: C/C++, Java, GTK, PAM, OpenOBEX, XML, BerkeleyDB, Internationalization, Macromedia Flash

Education:

July 2006:

PhD degree in Computer Science at Institute for Informatics and Automation Problems of National Academy of Science of the Republic of Armenia

Title: Universal Data Exchange Solution for Modern Distributed Data Acquisition Systems and Its Implementation for Cosmic Ray Monitor Networks.

2002-2005:

PhD Studies in Computer Science at Institute for Data Processing and Electronics at Forschungszentrum Karlsruhe

Topic: Fast middleware solutions for heterogeneous distributed data acquisition systems.

1996-2001:

M.Sc. in Mathematics at Moscow State University, Department of Mechanics and Mathematics, Chair: Mathematical Theory of Intelligent Systems

Diploma: Data processing using neural networks.

Publications:

[1]. M. Arenz, et al., “First transmission of electrons and ions through the KATRIN beamline,” JINST, vol. 13, P04020, 2018
[2]. P. Cavadini, H. Weinhold, M. Tonsmann, S. Chilingaryan, A. Kopmann, A. Lewkowicz, C. Miao, P. Scharfer, W. Schabel, “Investigation of the flow structure in thin polymer films using 3D µPTV enhanced by GPU, ” Experiments in Fluids, vol. 59, pp. 61, 2018
[3]. E. Ametova, M. Ferrucci, S. Chilingaryan, W. Dewulf, ”A computationally inexpensive model for estimating dimensional measurement uncertainty due to x-ray computed tomography instrument misalignments, ” Meas. Sci. Tech., vol. 29, no. 6, 065007, 2018
[4]. H. Mohr, T. Dritschler, L. E. Ardila, M. Balzer, M. Caselle, S. Chilingaryan, A. Kopmann, L. Rota, T. Schuh, M. Vogelgesang and M. Weber, “Evaluation of GPUs as a level-1 track trigger for the High-Luminosity LHC,” JINST, vol. 12, C04019, 2017
[5]. A. Chilingarian, S. Chilingaryan, T. Karapetyan, L. Kozliner, Y. Khanikyants, G. Hovsepyan, D. Pokhsraryan, S. Soghomonyan, ”On the initiation of lightning in thunderclouds”, Scientific Reports 7, Article 1371, 2017
[6]. N. Tan Jerome, S. Chilingaryan, A. Kopmann, A. Shkarin, M. Zapf, “WAVE: A 3D Online Previewing Framework for Big Data Archives,“ Proc. Intl. Conf. on Computer Vision, Imaging, and Computer Graphics Theory and Applications (IVAPP), Vol. 3, pp. 152-163, Porto, 2017
[7]. A. Kopmann, S. Chilingaryan, M. Vogelgesang, T. Dritschler, A. Shkarin, R. Shkarin, T. Dos Santos Rolo, T. Farago, T. Van De Kamp, M. Balzer, M. Caselle, M. Weber, T. Baumbach, “UFO — a scalable platform for high-speed synchrotron X-ray imaging”, Proc. Of 2016 IEEE NSS/MIC, Strasbourg, 2017
[8]. L. Rota, M. Vogelgesang, L. Ardila Perez, M. Caselle, S. Chilingaryan, T. Dritschler, N. Zilio, A. Kopmann, M. Balzer, M. Weber, “A high-throughput readout architecture based on PCI-Express Gen3 and DirectGMA technology,” Journal of Instrumentation, Volume 11, Issue 2, 8 pages, 2016
[9]. M. Arenz, et al., “Commissioning of the vacuum system of the KATRIN Main Spectrometer,” JINST, vol. 11, no. 04, pp. P04011, 2017
[10]. M. Vogelgesang, L. Rota, L. Perez, M. Caselle, S. Chilingaryan, A. Kopmann, “High-throughput data acquisition and processing for real-time X-ray imaging, ” in Proc. SPIE, vol. 9967, Developments in X-Ray Tomography X, 996715, 2016
[11]. J. Amsbaugh et al., "Focal-plane detector system for the KATRIN experiment," NIM-A, vol. 778, pp. 40-60, 2015
[12]. R. Shkarin, E. Ametova, S. Chilingaryan, T. Dritschler, A. Kopmann, A. Mirone, A. Shkarin, M. Vogelgesang, S. Tsapko, "GPU-optimized Direct Fourier Method for On-line Tomography," Fundamenta Informaticae, vol. 141, no. 2-3, pp. 245-258, 2015
[13]. A. Shkarin, E. Ametova, S. Chilingaryan, T. Dritschler, A. Kopmann, M. Vogelgesang, R. Shkarin, S. Tsapko, "An Open Source GPU Accelerated Framework for Flexible Algebraic Reconstruction at Synchrotron Light Sources," Fundamenta Informaticae, vol. 141, no. 2-3, pp. 259-274, 2015
[14]. A. Chilingarian, S. Chilingaryan, G. Hovsepyan, "Calibration of particle detectors for secondary cosmic rays using gamma-ray beams from thunderclouds," Astroparticle Physics, vol. 69, pp. 37-43, 2015
[15]. A. Chilingarian, S. Chilingaryan, A. Reymers, "Atmospheric discharges and particle fluxes," Journal of Geophysical Research: Space Physics, vol. 120, 2015
[16]. U. Stevanovic, M. Caselle, A. Cecilia, S. Chilingaryan, T. Farago, S. Gasilov, A. Herth, A. Kopmann, M. Vogelgesang, M. Balzer, T. Baumbach, M. Weber, “A Control System and Streaming DAQ Platform with Image-Based Trigger for X-ray Imaging,” IEEE Transactions on Nuclear Science, Volume 62, Issue 3, pp. 911-918, 2015
[17]. L. Rota, M. Caselle, S. Chilingaryan, A. Kopmann, M. Weber, “A PCIe DMA Architecture for Multi-Gigabyte Per Second Data Transmission,” IEEE Transactions on Nuclear Science, Volume 62, Issue 3, pp. 972 – 976, 2015
[18]. M. Caselle, M. Balzer, S. Chilingaryan, M. Hofherr, V. Judin, A. Kopmann, N. Smale, P. Thoma, S. Wuensch, A. Müller, M. Siegel, M. Weber, "An ultra-fast data acquisition system for coherent synchrotron radiation with terahertz detectors," Journal of Instrumentation, vol. 9, 2014
[19]. P. Lytaev, A. Hipp, L. Lottermoser, J. Herzen, I. Greving, I. Khokhriakov, S. Meyer-Loges, J. Plewka, J. Burmester, M. Caselle, M. Vogelgesang, S. Chilingaryan, A. Kopmann, M. Balzer, A. Schreyer, F. Beckmann, “Characterization of the CCD and CMOS cameras for grating-based phase-contrast tomography,” Proc. SPIE 9212, Developments in X-Ray Tomography IX, 2014
[20]. S. Chilingaryan, M. Caselle, T. Dritschler, T. Farago, A. Kopmann, U. Stevanovic, M. Vogelgesang, “Computing Infrastructure for Online Monitoring and Control of High-throughput DAQ Electronics,” Proc. of PcaPAC, Karlsruhe, 2014
[21]. M. Caselle, S. Chilingaryan, A. Herth, A. Kopmann, U. Stevanovic, M. Vogelgesang, M. Balzer, M. Weber, "Ultrafast Streaming Camera Platform for Scientific Applications," IEEE Transactions on Nuclear Science, vol. 60, iss. 5, pp. 3669-3677, 2013
[22]. H. Anzt, A. Beglarian, S. Chilingaryan, A. Ferrone, V. Heuviline, A. Kopmann, "A unified energy footprint for simulation software," Computer Science - Research and Development, 2012
[23]. M. Vogelgesang, S. Chilingaryan, T. dos Santos Rolo, A. Kopmann, “UFO: A Scalable GPU-based Image Processing Framework for On-line Monitoring,” Proceedings of HPCC-ICESS, pp. 824-829, 2012
[24]. S. Chilingaryan, A. Mirone, A. Hammersley, C. Ferrero, L. Helfen, A. Kopmann, T. dos Santos Rolo, P. Vagovic, "A GPU-Based Architecture for Real-Time Data Assessment at Synchrotron Experiments," IEEE Transactions on Nuclear Science, vol. 58, iss. 4, pp. 1447-1455, 2011
[25]. S. Chilingaryan, A. Kopmann, A. Mirone, T. dos Santos Rolo, M. Vogelgesang, “A GPU-based architecture for real-time data assessment at synchrotron experiments,” in proceedings of SC11 supercomputing conference, pp. 51-52, Seattle, 2011
[26]. S. Chilingaryan, A. Beglarian, A. Kopmann, S. Voecking, "Advanced data extraction infrastructure: Web based system for management of time series data," Journal of Physics: Conference Series, Volume 219, Part 4, 10 pages, 2010
[27]. A. Chilingarian et al, "Ground-based observations of thunderstorm-correlated fluxes of high-energy electrons, gamma rays, and neutrons," Physical Review D, Volume 82, Issue 3, pp. 043009, 2010
[28]. A. Chilingarian et al, Space Environmental Viewing and Analysis Network (SEVAN), Earth, Moon and Planets: Volume 104, Issue 1, pp. 195-210, 2009
[29]. S. Chilingaryan, A. Chilingarian, V. Danielyan and W. Eppler, "Advanced data acquisition system for SEVAN," Advances In Space Research 43, pp. 717-720, 2009
[30]. S. Chilingaryan, " The XMLBench Project: Comparison of Fast, Multi-platform XML libraries," Springer Berlin / Heidelberg: Lecture Notes in Computer Science, Volume 5667, pp. 21-34, 2009
[31]. S. Chilingaryan et al, "The Aragats data acquisition system for highly distributed particle detecting networks," Journal of Physics: Conference Series 119, 9 pages, 2008
[32]. S. Chilingaryan, A. Chilingarian, W. Eppler, A. Kopmann, Handling of Experimental and Slow Control Data for Large Scale Cosmic Ray Detection Networks, Proceedings of Int. Symp. FORGES 2008, pp. 68-75, 2008
[33]. A. Chilingarian et al, Space Environmental Viewing and Analysis Network (SEVAN), Central European Astrophysical Bulletin 31, pp. 259-272, 2007
[34]. S. Chilingaryan, A. Chilingarian, V. Danielyan, W. Eppler, Advanced Data Acquisition System for SEVAN, Proceedings of Solar Extreme Events Symposium, CD, Sep. 2007
[35]. A. Chilingaryan for the ASEC team, "Correlated Measurements of Secondary Cosmic Ray Fluxes by the Aragats Space-Environmental Center monitors," NIM-A 543, pp. 483-496, Jan. 2005
[36]. S. Chilingaryan, W. Eppler, "High Speed Data Exchange Protocol for Modern Distributed Data Acquisition Systems based on OPC XML-DA," Proceedings of 14th IEEE NPSS Real Time Conference 2005, CD, Jun 2005
[37]. W. Eppler, A. Beglarian, S. Chilingaryan, S. Kelly, V. Hartmann, H. Gemmeke, "New Control System Aspects for Physical Experiments," IEEE Transactions on Nuclear Science, vol. 51, No. 3, pp. 482-488, Jun 2004
[38]. S. Chilingaryan, "Using XML based solutions in Next Generation of Data Acquisition Software," Proceedings of 6th Irano-Armenian Workshop on Intelligent Information Technology In Control and Data Processing (IITinCDP 2004), CD, Feb 2004
[39]. S. Chilingaryan, W. Eppler, "Universal Dara Exchange Protocol based on OPC XML," Proceedings of 2nd Workshop on Information Technology and Its Disciplines (WITID 2004), pp. 248-252, Feb. 2004
[40]. A. Chilingaryan et. All, "Aragats space-environmental center: status and SEP forecasting possibilities," Journal of Physics G: Nucl. Part. Phys. 29, pp. 939-951, 2003
[41]. S. Chilingaryan, A. Beglaryan, W. Eppler, N. Gevorgyan, H. Sogoyan, S. Tserunyan, "The ASEC Data Acquisition: Distributed Hybrid Microchip Based System," Proceedings of 13th IEEE NPSS Real Time Conference 2003, CD, May 2003
[42]. W. Eppler, A. Beglarian, S. Chilingaryan, S. Kelly, V. Hartmann, H. Gemmeke, "Slow Control System Aspects for a Large Neutrino Experiment," Proceedings of 13th IEEE NPSS Real Time Conference 2003, CD, May 2003
[43]. A. Vardanyan, S. Chilingaryan, W. Eppler, H. Gemmeke, "Fast pattern recognition trigger for atmospheric Cherenkov telescopes," Proceedings of ICRC 2001
[44]. A. Chilingarian, E. Sevinian, S. Chilingaryan, "The non-linear signal domain selection using a new quality function in neural net training," NIM-A 389, pp. 242-244, 1997

Personal Data:

Date of Born: January 12, 1979
Spoken Languages: Russian, English, Armenian
Current Location: Karlsruhe, Germany