#Announcement

Launching Struct Chat Platform: Reinventing Chat

Manish R Jain  •  Jun 22, 2023

Introducing Struct: A new, innovative chat platform embodying the CRISPY framework. Struct challenges the status quo, turning real-time communication into accessible, lasting knowledge and reinventing chat as we know it.

Chat platforms today are inherently broken. Slack and Discord, the most commonly used chat platforms, while useful for real-time communication, create knowledge black holes, hindering the effective storage and retrieval of information.

This article is divided into 3 main sections. In section 1, I dissect the challenges plaguing existing chat platforms. In section 2, I introduce the CRISPY framework that outlines six underlying principles all chat platforms should strive to uphold.

And finally in section 3, I introduce Struct -- a new, innovative chat platform embodying this framework. Struct challenges the status quo, turning real-time communication into accessible, lasting knowledge and reinventing chat as we know it.

This blog post made it to the front page of Hacker News, resulting in a very fruitful discussion.

1. Communication Does NOT Equal Knowledge

Since the dawn of civilization, humans have been communicating. Exchanging stories over the warm glow of campfires, and sharing thoughts over a communal meal, these exchanges form the bedrock of human connection.

These conversations, while essential for social bonding and creating shared experiences, do not always translate into lasting knowledge. While knowledge is shared in these exchanges, without any effective capture process, they are rendered as mere memories: forgotten or irrecoverably altered over time like a game of telephone.

Capturing knowledge and maintaining it for the future required us to invent writing and printing. It involves the process of capturing, documenting, organizing, and storing information effectively. Once captured, a written word can be handed down over generations and centuries, informing all future communication.

The current chat platforms like Slack, Discord, and others allow us to communicate. But, these platforms fail at converting these conversations into knowledge. And therein lies the biggest problem that millions of users of these platforms suffer on a daily basis.

Chat Platforms are Knowledge Black Holes

As the founder of Dgraph Labs, the fastest-growing open-source Spanner-like graph database -- I was running a growing and very active Slack community of Dgraph users. We had over 3000 members in Slack. It was the main source of support for our user base. And while Slack provided a real-time mode of communication -- its problems were manyfold.

Horrible Search: After dedicating over six years to Google Web Search infrastructure, I've come to appreciate the intricate balance between content, context, and 'meatiness' that makes any document fully searchable. Imagine each conversation as a document. It's not just an isolated message or two, but a group of related messages, all encapsulating the same train of thought.

In the case of Slack, however, this ideal of a "document" is dramatically scaled down to a single chat message. This limitation inherently strips away the rich context and substantial content that make a conversation ripe for efficient searching. Consequently, this is why searching within Slack often feels like a wild goose chase.

New Message Whac-a-Mole: There is an endless stream of bold-font channels to chase. In Slack, a channel with bold fonts means it has a new message. Every new message in the channel would cause it to become bold. It was a tiring job as an open-source maintainer, playing Whac-a-Mole with new messages popping over an array of channels.

The N+1 Channel Conundrum: Given that creating a channel is the sole means of establishing the context within Slack, there always seems to be a need for 'just one more channel' to cater to slightly different contexts. This approach results in a channel explosion, making navigation and organization an uphill battle.

The Echo of Repetition: Slack struggles with capturing and making knowledge readily available, leading to recurring questions that endlessly loop back into the conversation.

Notification Avalanche: The barrage of notifications becomes relentless, descending on laptops, iPads, phones, and smartwatches without mercy. This constant bombardment is the only way to keep up with the real-time flow of messages -- because Slack just isn't designed for a 'later.'

Impossible Pricing Model: When running thousands of users on Slack, you have a choice between paying exorbitant amount of money to Slack or losing your chat history.

These are among the key reasons that led us to shut down our Slack instance, pivoting instead to Discourse. However, while Discourse is a useful platform, it's an asynchronous forum, not a real-time chat platform, making it an unsatisfactory substitute.

In fact, these issues aren't exclusive to Slack. The same complaint could be lodged against virtually any chat platform that exists today, whether it be Discord, IRC, or WhatsApp.

We can do Better.

I have thought about this problem for the past 5 years -- and arrived at a set of principles the ideal chat platform should aspire towards. And I've formulated all that into, what I call, the CRISPY framework.

Before I introduce the CRISPY framework, let's define what a conversation is. A conversation is a series of related chat messages exchanged between two or more participants. These messages, covering a single topic, together form a complete conversation.

2. CRISPY: Framework for an Ideal Chat Platform

CRISPY is a framework that defines what one should expect from a platform that they use for meaningful communication. A platform that can not only support effective real-time communication but also capture knowledge and make it accessible.

The CRISPY framework has 6 principles:

  • Contextual Clarity: Each conversation should have a defined title and summary for immediate understanding.
  • Real-time Interactions: Streamline short-form chats and implement real-time indicators to make the conversation lively and engaging.
  • Isolation: Enable clear separation of concurrent conversations to maintain focus and avoid confusion.
  • Spam Control: Implement robust measures to filter and prevent unwanted or disruptive messages.
  • Progressive Learning: Utilize AI to learn from the knowledge shared in past conversations, predict and suggest responses, and improve the conversational experience.
  • Yieldful Search: Incorporate an advanced search feature for effortless retrieval of past conversations.

Each of these principles serves as the cornerstone for a platform that not only facilitates effective and real-time communication but also enriches them, making them accessible and leveraging their knowledge for future interactions.

How CRISPY are Existing Platforms?

Existing chat platforms like Slack and Discord fare poorly when looking from the prism of the CRISPY framework.

Principle Score Notes
Contextual Clarity 0 Bad. Must read each message to understand if it's relevant.
Real-time Interactions 1 Good. But, no real-time indicators for Slack threads.
Isolation 0 Bad. Channel level isolation is too broad.
Spam Control 0 Bad. Slack has practically zero spam control.
Progressive Learning 0.5 None yet. Slack GPT is a step in the right direction.
Yieldful Search 0 Bad. Described earlier.
Overall 1.5/6 Slack / Discord

In fact, after searching over the years, I've come to realize that no existing chat platform abides by the CRISPY framework. And that's not just because I came up with the framework. While I've formulated them into an acronym, these are reasonably expected principles from any knowledge-communicating platform.

For example, many email platforms and forums can give you 4 out of 6. Contextual Clarity, Isolation, Searchability and Spam Control. They can't provide real-time interactions. And there's probably work going on for progressive learning.

Principle Score Notes
Contextual Clarity 1 Good. Subject lines for each conversation.
Real-time Interactions 0 Bad. Not designed for short-form, real-time messaging.
Isolation 1 Good. Each conversation is in a separate thread.
Spam Control 1 Good. Spam control mechanisms are state of the art.
Progressive Learning 0.5 None yet. I'm guessing that work is going on.
Yieldful Search 1 Good. Search is typically good. Each conversation is one search document.
Overall 4.5/6 Email / Forums

Given any decades-old email platform can score a 4.5, chat platforms are objectively worse. You get real-time interactions, and you pretty much give up on everything else. With a score of 1.5, chat platforms are a horrible solution.

Lately, Slack and Discord, have both added threads to allow some level of isolation. But, to achieve that, they had to break away from what made them special -- the liveness of conversations. They have taken a live, real-time chat platform, with typing indicators, and hidden it all behind a number. It's a hacky design, which doesn't align with their emphasis on real-time communication.

Slack Thread

At this point, some readers would say -- you communicate in the chat platform. And then you capture that knowledge in other places. That's a very common practice. And I won't dwell much into it, but just say one thing -- it's an obvious "faster horses over cars" argument.

We can do better. Much better.

3. Introducing Struct

For the past 6 months, my team and I have been tirelessly building a new kind of chat platform – Struct. Struct fully embodies the principles of the CRISPY framework, reshaping the very concept of what a chat platform can be.

Struct is a unique combination of a chat platform for public communities (like Discord), teams (like Slack), and live support (like Zendesk / Slack Connect). It tackles the hard job of marrying live chat with a thread-first approach to conversations while utilizing AI to generate context.

Here's Struct when seen from the prism of the CRISPY framework:

Principle Score Notes
Contextual Clarity 1 Good. AI-generated title and summary for each conversation.
Real-time Interactions 1 Good. Designed for short-form, real-time messaging. Launching with Stage 2.
Isolation 1 Good. Each conversation is in a separate thread.
Spam Control 1 Good. Advanced spam-control mechanisms launching in Stage 2.
Progressive Learning 1 Good. AI-powered chat interface launching by end-July.
Yieldful Search 1 Good. Combines full-text with vector embeddings for powerful search.
Overall 6/6 Struct

We're launching Struct in two stages:

  • Stage 1 launching today: Ability to funnel conversations from Slack and Discord into Struct, to build a knowledge base. Useful for groups who can't move away from Slack or Discord.

  • Stage 2 launching in Q3, 2023: Ability to use the Struct chat platform, replacing a Slack or Discord instance. Useful for groups that can move away from Slack / Discord and adopt Struct fully.

Struct: Stage 1 is Launching Today

For stage 1, we focused on bringing three core principles of CRISPY – contextual clarity, searchability, and progressive learning – to existing chat platforms like Slack and Discord. To accomplish this, we've developed innovative bots that extract threaded conversations and funnel them into Struct.

Struct then utilizes AI to

  • generate the title, summary, and resolution status of the conversation for context,
  • generate vector embeddings for each page to power search and similar threads,
  • create an SEO-optimized 'knowledge' page for each thread making the page accessible forever,
  • conversational responses to users' queries utilizing captured knowledge.

This generates a knowledge base out of existing conversations in Slack and Discord, with every thread getting a server-side rendered page dedicated to that conversation. As an example, see the same Slack thread (as above) when served by Struct.

Typesense KB Struct Thread

You too can transform your Slack or Discord communication into a comprehensive knowledge base. Follow these links to get started:

In essence, Struct is transforming what is currently a knowledge black hole into an intelligent, interactive, searchable knowledge base.

Struct: Stage 2 Waitlist is Now Open

In Stage 2, the Struct Chat Platform would be available in all its glory to replace reliance on Slack or Discord. I'm thrilled to announce that the launch of the Struct Chat Platform is slated for Q3, 2023, and we're officially opening our waitlist, so sign up today! Stage 2 would fulfill our initial vision of a radically better chat platform.

Pricing Model

Now, let's talk about pricing. The industry standard model of charging per user or per agent never quite sat well with me. It's time to shake things up. At Struct, we're bringing three different use cases - communities, teams, and customer support - under one platform. This unique blend demands an innovative pricing model that can accommodate the varied needs of these groups.

Struct is a thread-first chat platform. So, it makes sense to start there. Our current pricing model is based on threads. Instead of charging $7.25 per user per month as Slack does, we charge $0.13 per thread per month, an innovative usage-based pricing model. The more threads Struct has, the more knowledge has been captured and the more value it generates.

This pricing model works well for teams of size 5 to communities of size 100,000. Combined with the ability to intelligently forget threads which don't have any long-term value, this model can generate reasonable, predictable pricing across the entire spectrum.

Is this the holy grail of pricing? We don't have all the answers yet. But we're committed to exploring new possibilities and confident that our efforts will lead to a better pricing model for everyone.

Struct has Amazing Users

Already, Struct is enhancing communication for several online communities: Chatwoot, Grafbase, Infisical, OpenObserve, Supertokens, Tooljet, and Typesense. This is what Jason Bosco, co-founder of Typesense, had to say about Struct:

I’ve always been worried about how all the good discussions we’re having in our Slack community are inside a walled garden and are hard for people to find. I love that with Struct.ai, we’re now able to have these discussions publicly indexed and easily discoverable. The summaries on top of each thread are incredibly useful.

Struct: Chat Reinvented

In a world that's been communicating in real-time, but faltering when it comes to preserving knowledge, we believe it's time to do things differently. As we've discussed, platforms like Slack and Discord, though important for communication, often fall short when it comes to capturing and maintaining knowledge. But what if a chat platform could also be a vault of wisdom?

The CRISPY framework, conceived from years of observing and dealing with these challenges, suggests a pathway to a more efficient, knowledge-rich chat environment.

I'm proud to introduce Struct, an innovative chat platform that embodies this framework. In its first stage, Struct begins by turning Slack and Discord into searchable knowledge bases. In the second stage, it evolves into a full-fledged, standalone chat platform, redefining the concept of online communication.

Struct Chat, Inc., the company behind Struct, is backed by SignalFire, Ratio Ventures; founders of Planetscale, Supabase; and executives from Yelp, Mint.com, and others. The chat platform space feels saturated -- and yet, there isn't a great solution. Our investors stood behind the vision that we're going for. I'm very thankful for their investment, which helped us get to this launch milestone.

Finally, three links you should follow:

The journey is just beginning because, with Struct, we're reinventing chat, we're reinventing how people communicate -- and that's never an easy task. So, come, witness, and join the reinvention.