APAC CIOOutlook

Advertise

with us

  • Technologies
      • Artificial Intelligence
      • Big Data
      • Blockchain
      • Cloud
      • Digital Transformation
      • Internet of Things
      • Low Code No Code
      • MarTech
      • Mobile Application
      • Security
      • Software Testing
      • Wireless
  • Industries
      • E-Commerce
      • Education
      • Logistics
      • Retail
      • Supply Chain
      • Travel and Hospitality
  • Platforms
      • Microsoft
      • Salesforce
      • SAP
  • Solutions
      • Business Intelligence
      • Cognitive
      • Contact Center
      • CRM
      • Cyber Security
      • Data Center
      • Gamification
      • Procurement
      • Smart City
      • Workflow
  • Home
  • CXO Insights
  • CIO Views
  • Vendors
  • News
  • Conferences
  • Whitepapers
  • Newsletter
  • Awards
Apac
  • Artificial Intelligence

    Big Data

    Blockchain

    Cloud

    Digital Transformation

    Internet of Things

    Low Code No Code

    MarTech

    Mobile Application

    Security

    Software Testing

    Wireless

  • E-Commerce

    Education

    Logistics

    Retail

    Supply Chain

    Travel and Hospitality

  • Microsoft

    Salesforce

    SAP

  • Business Intelligence

    Cognitive

    Contact Center

    CRM

    Cyber Security

    Data Center

    Gamification

    Procurement

    Smart City

    Workflow

Menu
    • Capital Market
    • Cyber Security
    • Hotel Management
    • Workflow
    • E-Commerce
    • Business Intelligence
    • MORE
    #

    Apac CIOOutlook Weekly Brief

    ×

    Be first to read the latest tech news, Industry Leader's Insights, and CIO interviews of medium and large enterprises exclusively from Apac CIOOutlook

    Subscribe

    loading

    THANK YOU FOR SUBSCRIBING

    • Home
    Editor's Pick (1 - 4 of 8)
    left
    Tech Strategy for Capital Markets and Other

    Jeff Roberts, CIO, HFF

    Transformations in Financial Technologies

    Jacob Sorensen, CIO, Bank of the West

     Capital Markets Firms Looking for Low Friction Solutions

    Vic Winkler, CTO, Covata

    From the Chief Information Officer to the Chief Innovation Officer : Leading the Digital Transformation

    Bjoern Goerke, CIO, SAP AG

    Interconnected Trust - The Digital Economy's Renewable Energy

    Rocky Scopelliti, Director at Optus Futurologist & Author, Youthquake 4.0

    Five Benefits of Open APIs + Marketing Automation

    Mark Bantique, Vice President, Head of E-Commerce, Security Bank Corporation

    Digitisation of Capital Markets

    David Heathcote, Global Head of Debt Advisory, KPMG

    Digital Disruption and the Future of Capital Markets

    Kenneth Lee, Head of Primary Bond Markets, Natixis Asia Pacific

    right

    Innovations in Market Surveillance and Monitoring

    Dr.John Bates, CTO, Intelligent Business Operations & Big Data, Software AG

    Tweet
    content-image

    Dr.John Bates, CTO, Intelligent Business Operations & Big Data, Software AG

    Crises in capital markets are often hitting the headlines today. In 2010, a “Flash Crash” caused the Dow Jones Industrial  average to tumble almost a thousand points before recovering most losses within 30 minutes. In 2011, a rogue trader cost Swiss banking group UBS $2Bn by hiding risky trades using knowledge of front, middle and back office systems. In 2012, an automated trading algorithm at Knight Capital went haywire and fired inappropriate orders at high frequency into the market for 30 minutes before it was identified and stopped—costing Knight Capital $450Mn in trading losses and near bankruptcy. Also, in 2012, a new crisis arose from trader collusion fixing the LIBOR inter bank rate. In 2013, a similar crisis emerged around the fixing of foreign exchange benchmark rates through market manipulation and trader collusion. These are just a few  high profile cases—many “mini crises” are happening with more frequency. A capital markets trading firm must prepare to deal  with, and ideally prevent,these incidents.

    Catching the Rogues Red-Handed

    Market surveillance, the compliance function aimed at monitoring market abuse, market manipulation and improper behaviours,  has been a laggard compared to its trading counterparts. Some liken this to traders driving Ferraris and the surveillance  team chasing them on bicycles! However, innovations in technology has seen the development of realtime market surveillance  p platforms that now equip compliance teams with Ferrari police cars. These platforms utilize similar technology for real-time  pata analysis and response as used in advanced trading systems. They look for patterns in data (trade data, social networks, news data etc.) that indicate potential market manipulation, trader collusion, rogue trading or wild algorithms. Occurrences are flagged to compliance staff for investigation and cross-referencing.

    "Innovations in technology has seen the development of real-time market surveillance platforms that now equip compliance teams with Ferrari police cars"

    Technologies converging to form next generation surveillance platforms include in-memory data management, analytic and decision tools. In-memory technologies, such as high performance messaging and in-memory data grids, enable data to be collected and made memory resident, ensuring data is highly available and can be processed rapidly. Complex Event Processing (CEP) (sometimes called “streaming analytics”) enables data to be analyzed as it is collected and patterns representing relationships between data items (events) identified.

    Visual analytics allows discovered alerts to be represented as graphs,  heatmaps and other intuitive, visually explorable metaphors. Humans can drill into complex alerts to see what the root cause analysis is. Alerts can also trigger processes, such as automatically creating a case and launching a workflow for a compliance officer to investigate an incident.

    One example is the collection of news events, trade events, and trader behaviour, and observing an unusually large trade placed by a trader that doesn’t usually trade in that instrument seconds before a news event comes out that significantly moved the market. Perhaps it was luck or intuition; perhaps not. A visual representation of the alert can then be examined and an investigation workflow launched.

    Tuning the Machine

    If you have the right technology, and you know what you’re seeking, you can detect the rogues. However, one particular  challenge that has kept surveillance analysts busy for years is figuring out how to calibrate the monitoring logic for best results.

    Too few alerts raise concerns that improper behaviours are going undetected, i.e. false negatives. Too many alerts are a clear sign that behaviours that are perfectly reasonable are being flagged as improper, i.e. false positives.

    The ‘calibration’ of behavioural monitoring is a non-trivial task with the profiles of institutional vs. retail, electronics,voice, exchange traded vs. OTC and other factors all playing a role in how monitoring should be configured. For example,  'front running’ is commonly thought of as placing a proprietary order in the market ahead of a large client order that will  likely move the market. How much time is allowed between the proprietary and agency orders? What is large? What defines  movement in the market? These parameters vary widely based on the profile of business being transacted and so calibration is  a specialised challenge that should be considered unique to each firm.

    Over the years, market surveillance vendors provided clients with the means to help ‘calibrate’ their behaviour monitoring  with varying degrees of success. At one end of the spectrum, vendor platforms simply generate alerts (or not) and provide  tools to fine-tune parameters over time. Surveillance analysts are expected to learn on-the-job and gradually improve their monitoring through trial and error.

    Amazingly, this time-consuming, error-prone method was the norm for years. Not only is it an enormously wasteful approach, it exposes the firm to serious regulatory risk while their monitoring gradually improves to the point where it could be  considered genuinely effective.

    Further along the spectrum are tools to replay, or back-test, large quantities of historical data to conduct what-if  cenarios, i.e. what-if the time between the proprietary order and the agency order was three seconds? Again in this area, CEP  technology has been used to allow surveillance analysts to fine tune the parameters in a protected environment. Analysts are  still learning through trial and error, but at a greatly accelerated rate and not with live orders/trades and hence reduce  the firm’s exposure to regulatory risk. But this technique still requires a brute force approach to understanding what is"normal” behaviour in an attempt to detect what is abnormal.

    Charting the Unknown

    Lately, I have seen the market demanding innovation to spot the potential emergence of new patterns. To achieve this, data is  recorded and replayed over many months into analytics in a CEP/streaming analytics engine to calculate and benchmark what is  "normal”, including trader behaviour, market behaviour etc. This analytic process continues in real-time to continually refine the model of “normal” and to monitor for unusual events. When anything beyond a certain tolerance or standard deviation from “normal” is detected, an alert is triggered possibly indicating new abnormal behaviour. A member of the compliance team can investigate and categorize it accordingly. In this way, surveillance becomes a self-evolving system, combining machine pattern detection with human intuition and experience.

    tag

    Data Management

    Weekly Brief

    loading
    Top 10 Capital Market Tech Solution Companies - 2019
    ON THE DECK

    Capital Market 2019

    I agree We use cookies on this website to enhance your user experience. By clicking any link on this page you are giving your consent for us to set cookies. More info

    Read Also

    Artificial Intelligence - Myths And Truths

    Artificial Intelligence - Myths And Truths

    Geraldo Pereira Junior, Chief Information Officer, Ypê
    Sustainable Future through Innovative Technology Solutions

    Sustainable Future through Innovative Technology Solutions

    Faisal Parvez, Director, BT Business CIO
    The Future Relies on Augmented AI

    The Future Relies on Augmented AI

    Laurent Fresnel, CIO, The Star Entertainment Group
    Digitalization with the use of digital technologies/Improving business through digital technologies

    Digitalization with the use of digital technologies/Improving business through digital technologies

    Wilbertus Darmadi, CIO, Toyota Astra Motor
    How Marco's Pizza Leaned On Technology To Succeed Amid The Pandemic By Quickly Pivoting To Contact-Free Delivery And Curbside Carryout

    How Marco's Pizza Leaned On Technology To Succeed Amid The Pandemic By Quickly Pivoting To Contact-Free Delivery And Curbside Carryout

    Rick Stanbridge, VP & Chief Information Officer, Marco’s Pizza
    Bunnings  Diy Digital Transformation

    Bunnings Diy Digital Transformation

    Leah Balter, Chief Information Officer, Bunnings
    For a Smarter City: Trust the Data, Ignore the Hype

    For a Smarter City: Trust the Data, Ignore the Hype

    Brad Dunkle, Deputy CIO, City of Charlotte
    Smart Community Innovation for the Post Pandemic

    Smart Community Innovation for the Post Pandemic

    Harry Meier, Deputy Cio for Innovation, Department of Innovation and Technology, City of Mesa
    Loading...
    Copyright © 2025 APAC CIOOutlook. All rights reserved. Registration on or use of this site constitutes acceptance of our Terms of Use and Privacy and Anti Spam Policy 

    Home |  CXO Insights |   Whitepapers |   Subscribe |   Conferences |   Sitemaps |   About us |   Advertise with us |   Editorial Policy |   Feedback Policy |  

    follow on linkedinfollow on twitter follow on rss
    This content is copyright protected

    However, if you would like to share the information in this article, you may use the link below:

    https://capital-market.apacciooutlook.com/ciospeaks/innovations-in-market-surveillance-and-monitoring-nwid-891.html?utm_source=google&utm_campaign=apacciooutlook_topslider