Process Book: Insightful Stock Charting

Basic Information

Project Title: Insightful Stock Charting
Team Members: Project Repository: quantviz

Background and Motivation

Traditional stock charts, predominantly those on platforms like finviz.com, have been criticized for their cluttered, complex, and seemingly outdated nature. They often rely on technical analysis methodologies that have faced skepticism and are considered by some as pseudoscientific. On the contrary, the contemporary financial landscape has welcomed the rise of sophisticated financial, news, and alternative data sources such as polygon.io and quiverquant. These platforms offer invaluable insights into the US equity market, presenting data that can be streamlined into intuitive and thorough analysis.

Our team is inspired by the idea of reimagining stock chart visualizations. We aim to meld these contemporary data sources, offering actionable insights in a more user-friendly format. Our goal is to cater to the emerging generation of investors, including those with a rudimentary understanding of the financial world, such as recent college graduates. By presenting data in an intuitive and insightful manner, we hope to bridge the gap between complex financial data and its practical application.

Visualization Questions

  1. Trend Identification:

    • What is the overall trend of the stock's price movement over a specific period?
    • Are there identifiable patterns or trends, such as bullish or bearish movements?
  2. Key Performance Metrics:

    • How does the stock's trading volume correlate with price movements?
    • What do the key technical indicators suggesting about the stock's performance?
  3. Market Sentiment Analysis:

    • How are news and events indicative of the stock's performance?
    • Can sentiment analysis of news headlines or social media sentiments be correlated with stock movements?
  4. Historical Comparison and Analysis:

    • How does the stock's current performance compare to its historical data?
    • Are there recurring patterns or behaviors?

  5. Over time, as our visualization objectives changed, our questions morphed into inquiries about stock comparison and how to convey info to novices without too much clutter.

  6. Comparative Analysis:

    • How does this stock compare to its industry peers or benchmark indices?
    • Are there relative strength or weakness indicators compared to similar stocks?
  7. Education and Guidance for Novices:

    • How can novices interpret and understand the visualizations easily?
    • Are there tooltips, explanations, or guides embedded to assist in understanding the displayed data?
  8. Actionable Insights and Decision Support:

    • What actionable insights can investors derive from the visualization?
    • How can the visualization guide investment decisions for individuals with varying levels of expertise?

Project Objectives

Our objectives for this project are manifold:

Benefits:

Data Collection and Processing

Primary Data Sources:

Data Collection and Integration: Data will be consistently fetched via API integrations with the aforementioned sources and subsequently stored in our MongoDB database. Given the diverse nature of these data sources and the requisite need for real-time processing, substantial data cleanup and processing will be anticipated. Key metrics like option pressure data and short-term call/put trading volume will be derived. The Python backend will shoulder the responsibilities of data collection, sanitization, processing, and final storage in MongoDB.

Exploratory Data Analysis

In our exploration of stock data utilizing Quiver Quant and Yahoo Finance, we initially immersed ourselves in a vast array of available data and charting options. However, we quickly realized that the charts presented an overwhelming amount of information, potentially leading to confusion, particularly for novice users. This observation emphasized the need for simplification without compromising the depth of insights.

To streamline complexity, we opted for a minimalist approach. We found that condensing the wealth of data into a single trend line while providing multiple options for charting proved most effective and straightforward. This approach allowed users to focus on the primary trend while offering flexibility to explore additional data points or indicators based on their preferences.

By consolidating information into a single trend line with customizable features, our goal was to offer simplicity without sacrificing depth of analysis, ensuring accessibility for users of varying expertise levels.

Features

Must-Have Features:

Optional Features:

Project Schedule

PROPOSAL (DUE Oct 30):

Repository initialization, preliminary design sketches, and API integrations.

MILESTONE 1 (DUE Nov 13):

MILESTONE 2 (DUE Nov 27):

PRESENTATION (DUE Dec 5):

FINAL SUBMISSION (DUE Dec 18):

Visualization Sketches

Bubble Chart - Step 1
Alternative Design: Bubble Chart - Step 1

Bubble Chart - Step 2
Alternative Design: Bubble Chart - Step 2

Bubble Chart - Step 3
Alternative Design: Bubble Chart - Step 3

Heatmap Design 1
Alternative Design: Heatmap - Step 1

Heatmap Design 2
Alternative Design: Heatmap - Step 2

Heatmap Design 3
Alternative Design: Heatmap - Step 3

Chart Hovering Feature
Additional Feature: Chart Hovering

EPS Feature Display
Additional Feature: EPS Display

Website UI Design
Website UI Display

Final Design
Final Design

Project Workflow
Project Workflow Chart

Milestone 1: Options Chart Visualizations

Our first milestone for the Insightful Stock Charting project includes a series of option charts that are crafted to depict bearish and bullish price movements effectively. The red lines indicate bearish trends, while the green lines represent bullish trends, providing an intuitive understanding of market sentiment at a glance.

Our charts are designed with a dark background to ensure that the colors of the price movements are distinctly visible to enhance the user's focus on the data. This choice is deliberate to minimize visual strain and improve the contrast ratio, which is particularly beneficial for extended periods of analysis.

Each chart represents different time frames—1 week, 1 month, 1 year, and 5 years—offering users a comprehensive view of market trends over varying periods. This temporal flexibility allows for a detailed analysis tailored to the investment knowledge of the user.

1 Week Options Chart for AMC
1 Week Options Chart - This short-term view focuses on immediate market reactions and sentiment.
1 Month Options Chart for AMC
1 Month Options Chart - Balances short-term movements with emerging trends.
1 Year Options Chart for AMC
1 Year Options Chart - A broader view to assess long-term strategies and market cycles.
5 Years Options Chart for AMC
5 Years Options Chart - Provides insights on long-term performance and the sustainability of market trends. It is essential for users interested in long-term investments and historical performance analysis.

This interface is intentionally minimalist, placing the emphasis on the data itself. Hovering over a section of the chart displays a tooltip that provides additional details, including the date, price, and option pressure. This feature is particularly useful for users who wish to gain a deeper understanding of the data. Searching for a specific stock ticker will eventually call our mongodb database and return company-specific data, news, and other related information.

We added a time selector below each chart that enables a more interactive exploration of stock performance. By allowing users to switch between different time frames, they can gain a multi-dimensional understanding of stock behavior, which is crucial for making informed investment decisions.

The design and functionality of these charts are representative of our project's goal of providing investors with a clear, concise, and interactive tool for stock market analysis. The Insightful Stock Charting project strives to empower its users by offering a platform that is both informative and user-friendly.

Milestone 2:

Relevant News Articles

News feature image When a stock ticker is searched for, we find and display the 10 most recent news articles related to that stock. This helps our users stay informed about a company's current events.

Stock Tree Map

Tree Chart

Our tree chart is crafted with intentionality, where minimalism in design converges with maximalism in data depth. The interface foregrounds the data, allowing the market dynamics of the S&P 500 to speak for themselves. Each block in the tree chart corresponds to an individual stock, scaled to represent its market capitalization within the index. This scaling is intuitive, providing a visual shorthand for the stock's relative size and influence in the market.

Interactivity is woven into the fabric of the chart. A user's hover unveils a tooltip—a detailed vignette of financial data that includes the latest stock price, the percentage change within the selected timeframe, and the market cap. The additional layer of option pressure data is pivotal, offering insight into market sentiment and potential future movements.

The chart goes beyond static displays, beckoning users to engage with the data. This includes not just numbers but narratives, with up-to-date news and analytics painting a full picture of a company's stock story.

Complementing the chart is a time selector, a feature that invites users to witness the stock performance across various temporal landscapes—daily, monthly, semi-annually, and annually. This control transforms the chart into a time machine, revealing the arc of stock narratives over different chapters of time. The color-coding is the final touch in this interactive canvas, where shades shift to reflect stock price changes—green for growth, red for decline—offering a quick visual cue to the market's heartbeat.

The design and functionality of our tree chart are emblematic of the Insightful Stock Charting project's philosophy—to elucidate the stock market through a clear, concise, and interactive lens. We are committed to stripping away the complexity of the financial markets, providing a platform where usability meets utility. Our project's ambition is encapsulated in this visualization: to equip investors with an informative, user-friendly tool that elevates their market analysis and decision-making.

User Study Plan

Objective: The purpose of this user study is to evaluate the usability and effectiveness of our stock visualization tool through structured 5-minute user surveys. The study aims to gather user feedback to identify areas for improvement and assess the clarity of displayed information.

Methodology:

  1. Timed Exploration (2.5-3 minutes):
    • Users will be given 2.5-3 minutes to explore the visualization tool with minimal guidance or instructions.
    • Clarifying questions asked by the user will be noted as areas of unclear information needing improvement.
    • Users will be encouraged to think aloud, expressing thoughts, and voicing any challenges or positive impressions encountered during the exploration. Instances where users struggle with visualizations or overlook features will be recorded.
  2. Interpretation Task:
    • After the timed exploration, users will be asked to interpret a stock ticker and the accompanying indicators displayed.
    • If the user accurately explains the stock's situation and indicators, it indicates successful visualization. Inaccuracies provide insights into areas where our visualization may lack clarity.
  3. Positive and Negative Feedback:
    • Users will be prompted to provide one positive and one negative aspect for each of the three visualization sections.
    • This feedback will help identify major highlights and areas for improvement in our visualization tool as perceived by the users.

Feedback:

We received feedback with the following thoughts:

Final Visualization

New Feature: NLP Machine Learning Sentiment Score

News NLP System

Our Stock Sentiment Indicator harnesses sophisticated Natural Language Processing (NLP) methodologies to present a dynamic real-time analysis of market sentiment concerning the top 100 stocks, as derived from the most recent news headlines. Tailored for both investors and traders, this tool offers an insightful glimpse into the prevailing mood of the stock market, portrayed on a scale ranging from 0 (indicative of negative sentiment) to 1 (reflecting positive sentiment).

Employing advanced NLP algorithms, each stock-related news headline undergoes meticulous sentiment analysis. These sentiment scores are then harmonized and standardized, resulting in a concise and comprehensive indicator for each stock.

A score nearing 1 signifies an overall positive sentiment within the stock-related news, while a score closer to 0 implies a prevailing negative sentiment. Continuously updated in real-time, this indicator stays abreast of the latest news and market trends.

Serving as a valuable asset in trading and investment decision-making, this indicator provides a rapid and effective means to gauge market sentiment. It serves as a complementary tool to traditional financial analysis, facilitating the identification of potential market dynamics and aiding in strategic decision-making processes.

Improved Stock Chart

New Stock Chart UI
  1. Inclusion of a Legend: A comprehensive legend was incorporated to clarify the range of values and elaborate on the chart colors. This addition aims to enhance user understanding by providing clear guidance on interpreting the displayed data.
  2. Refinement of Radio Buttons: The radio buttons were revamped, ensuring improved functionality for users to seamlessly switch between different stock metrics. This enhancement simplifies the process, enabling users to efficiently navigate and explore various data options. Users can also hover over the names for a brief tooltip.
  3. Introduction of Stock Comparison Feature: A new feature allowing side-by-side measurement of two stocks was implemented. This enhancement empowers users to compare the performance of different stocks simultaneously, facilitating more in-depth analysis and decision-making.
  4. Integration of Volume and Daily Change Metrics: Volume and daily change metrics were integrated into the chart, offering users additional essential information for analysis. This inclusion enriches the visualization by providing key metrics for a more comprehensive view of stock performance.
  5. Highlighting for Metrics and Timeline: Highlighting functionalities were introduced for both the selected metric and the timeline. This addition serves to guide users by visually indicating the selected elements, enhancing clarity and ensuring users are aware of their current selections.

Other Changes

  • A section was added at the top that explains how to use the chart and different definitions for explaining to beginner financiers. It also explains the goal of the visualization
  • The help page was modified to be more readable and easier to navigate
  • The news section was tweaked to open the page in a new window and has the link connected to the title
  • The sector tree chart was given a section to explain how to operate it and what it means
  • Names and labels of the tree chart were modified to be more clear and remove any unnecessary attributes
  • Items were made more responsive to the screen size and the tree chart legend is now visible without needing to scroll
  • We decided against moving the news section to the bottom because it is more directly relevant to the stock chart with the sentiment analysis
  • Other general styling changes to make site more aesthetic/clear
  • Evaluation of Visualizations

    Looking at the visualizations unveiled critical insights into stock data while adapting to evolving objectives over the course of the project. Initially, the visuals elucidated the stock's overall trends, showcasing distinct patterns like bullish or bearish movements. They effectively correlate trading volume with price shifts and provide insights from key technical indicators, accurately explaining the stock's performance indicators.

    Furthermore, the visualization gauged market sentiment by aligning news events with stock performance, showing a potential correlation between news sentiment and stock movements. Historical analysis unveiled the stock's current performance against past data, revealing recurring patterns and behaviors.

    As our focus shifted towards stock comparison and user-friendly representation, the visualizations evolved to cater to novice comprehension and actionable insights. They can now compare stocks with industry peers and included features for novices' easy interpretation. However, to enhance usability, tooltips and more user-friendly guides could be incorporated. The visualizations effectively guide investment decisions but could benefit from additional improvements in simplification and accessibility for users with varying expertise levels. Refinements in interface clarity and information representation could amplify the visualization's effectiveness further. The visualization could also do a better job of summarizing insights for the user.