System and method for the creation and automatic deployment of personalized, dynamic and interactive voice services with customized message depending on recipient

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

• • This application is a continuation of U.S. patent application Ser. No. 09/455,527, filed Dec. 7, 1999 now abandoned, entitled “SYSTEM AND METHOD FOR THE CREATION AND AUTOMATIC DEPLOYMENT OF PERSONALIZED, DYNAMIC AND INTERACTIVE VOICE SERVICES WITH CUSTOMIZED MESSAGE DEPENDING ON RECIPIENT,” the contents of which are hereby incorporated by reference in their entirety.

FIELD OF THE INVENTION

This invention relates to a system and method for creation and automatic deployment of personalized, dynamic and interactive voice services, including information derived from on-line analytical processing (OLAP) systems and other data repositories, with customized messages depending on the recipient.

BACKGROUND OF THE INVENTION

Hearing information is one of the fastest, most efficient means of receiving communication. The automated distribution of information via telephone to a recipient can be beneficial. One drawback, however, is that if the intended recipient does not answer the phone, sensitive information may be compromised. For example, many people use answering machines or voice mail to take a call when they cannot answer their telephone. The delivery of sensitive information to such a device, or another individual who happens to answer the phone who is not the intended recipient, can be problematic. This is a drawback with automated delivery of sensitive information via telephone. These and other drawbacks exist with current systems.

SUMMARY OF THE INVENTION

An object of the invention is to overcome these and other drawbacks in existing systems.

Another object of the invention is to provide a system and method for creation and automatic deployment of personalized, dynamic and interactive voice services, including information derived from on-line analytical processing (OLAP) systems and other data repositories, with customized messages depending on the recipient. For example, when an automated call is placed, the system can determine whether the recipient is the intended recipient, another person, a device or some other recipient. Based on this determination, the system can deliver a message that is customized based on previously set rules. By way of example, if the system determines that the recipient of an automated call is the intended recipient, detailed and sensitive information may be conveyed. If the recipient is a device (e.g., an answering machine, phone mail, etc.) another type of message may be left (e.g., that the intended recipient should call about some important information).

According to one embodiment of the invention, to ensure that the person who answered the phone is indeed the intended recipient of the call, a user may be prompted for a personal identification number (PIN), which can be compared the correct value. Only if the correct PIN is entered is the user directed to the main body of the call. Other authentication techniques may also be used. During a voice service set-up, (e.g., content creation), the message to be left for a Person can be specified in a dialog named “Person”. The message to be left for a device can be specified in a dialog named “Device.” These messages can be varied by an administrator.

This customized message feature is particularly useful with an automated voice service. One embodiment of a voice service relates to a system and method for creation and automatic deployment of personalized, dynamic and interactive voice services, including information derived from on-line analytical processing (OLAP) systems and other data repositories. The system and method enables the ability to capture user selections to facilitate closed-loop transaction processing and processing of other requests. One aspect of the invention relates to an interactive voice broadcasting system and method that enables analytical reporting and advanced transactional services via the telephone or other voice-enabled terminal device. One advantage of the invention is that a voice service may leverage the power of OLAP or other data repository systems and provide critical information to the user, in a timely fashion, by phone. Another advantage of this method and system is that it provides a user with the opportunity to immediately act upon information received during a interactive voice broadcast.

A voice service is created, to which many users may subscribe. Each user can specify personal preferences for the content and presentation of the contents for a voice service. The specification of the elements of a voice service may be done using a set of interfaces (such as GUIs) that take the form of a voice service wizard.

A voice service includes one or more Dialog elements. Dialog elements may include one or more of Speech elements, Input elements and Error elements. An Input element may include a Prompt element and/or an Option element. An Input element enables the system to request input from the user, capture the input and direct the call flow based on the user's input. An Option element associates a key (e.g., on a telephone touch pad dial) with a destination Dialog that is executed when that number is pressed by a user during an interactive voice broadcast. A Prompt requests a user to enter numeric or other information. An Input element may enable a user to request, during an interactive voice broadcast, a transaction, a service or other requests. The term transactions, services and requests are to be interpreted broadly.

According to one embodiment, the user's responses to Input elements are stored during an interactive voice broadcast and, during or after the voice broadcast, the stored information is processed by the system or is passed to another system or application for processing. The transaction (or other request) processing can be accomplished either in real-time, during the voice broadcast, or after the interactive voice broadcast is completed. The results or confirmation of a transaction or other request can be provided to the user during the call or subsequently.

Once a voice service is created, the system monitors predetermined conditions to determine when the voice service should be executed. Each voice service is executed when one or more predetermined conditions are met as specified during creation of the voice service. For example, a voice service may be executed according to a predetermined schedule (time-based) or based on a triggering event (e.g. one or more conditions are met based on the output of an OLAP or other report).

When the predetermined condition is satisfied, the voice service is executed. Executing a voice service includes the steps of generating the content specified by the voice service and the user preferences. Some users may have identical personalization options. (Thus, in one embodiment a single call structure may represent a group of users with identical personalization options). The content of the voice service includes the information that is to delivered to users of that voice service, and the Input to be requested from the user, among other things. The content may include, for example, static text messages, dynamic content (e.g. text based on information output from an OLAP report, other database or other sources), blended content (e.g. static text combined with dynamic content), sound clips, music, advertisements or other information.

This and other content along with a users personalization preferences are formatted in an Active Voice Page (AVP). An AVP contains the call structure and data, voice style parameters for the user and personal identification information designated for the user. The AVP contains data at various hierarchical levels that are defined by the Dialog elements defined for each voice service. The active voice pages are used to help govern the interaction between the call server and the user during an IVB. According to one embodiment, the content is formatted, into an AVP using XSL stylesheets so the AVP is in an XML-based language. According to one embodiment, the XML-based language used is a language referred to as TML (discussed below). The AVP is sent to a call server along with style properties for each user. The style properties of a user help determine the behavior of the call server during an interactive voice broadcast. A unique AVP is generated for each user scheduled to receive a voice service.

When a user is called by the call server, information is passed through a text-to-speech (T-T-S) engine and delivered to the user through a voice-enabled terminal device. Preferably, the structure of each call is dynamic, driven by current data values and is personalized based on a user profile established during subscription to a voice service. During a typical interactive voice broadcast, a synthesized, natural sounding voice greets the recipient by name, identifies itself, provides information relevant to the user and enables a user to provide input back to the system.

An IVB (Interactive Voice Broadcast) is a voice-enabled interaction with a user having a dynamic structure controlled by the AVP for the particular user. The IVB may be delivered using real-time, on-the-fly speech generation, sound clips, music, advertisements or other information. During an IVB, information is exchanged between the call server and a user according to the AVP. The system executes dialogs by reading messages to the user and eliciting input from the user. For example, the user may press buttons on a telephone touch pad dial to select an option or to provide numeric or alphanumeric input, or speech recognition input may be used. Each response provided by a user may transfer control of the IVB to a different part of the AVP.

During or after the IVB, the user's responses may be processed by the system or other applications. The AVP may contain pointers to other applications and embedded statements such that when a user exercises an option, the system performs a requested operation and returns the results to the user during the IVB. For example, by exercising an option, a user may request that a real-time database query be performed. When the user selects such an option, control is shifted to a portion of the AVP that contains an embedded SQL statement that is made against a database.

When a user has worked through selected dialogs of the AVP, the IVB is terminated. That is, a user likely will not work through all of the available dialogs during an IVB. Rather, the user's inputs and option selections determine which the available dialogs are encountered during any given IVB.

According to one aspect of the invention, an authentication module may be used to make an initial determination as to the identity of the recipient or service which has answered the call constituting an interactive voice broadcast. If the authentication module determines that the call has been received by the intended recipient, the Person Dialog may continue to be delivered. If a person other than the intended subscriber receives the call, the call may be terminated or secondary authentication performed. If a device picks up the call, a Device Dialog may be delivered or the call may be terminated. A variety of sub-dialogs may be embedded in a Person Dialog, or multiple Person Dialogs generated, or more than one version of a Device Dialog may be associated with a voice service to provide greater flexibility in delivering certain information if certain conditions are met.

A voice style is assigned to each voice address and is comprised of a set of call server parameters that govern the behavior of the server when the call software dials and interacts with the subscriber. The voice style include the properties, such as the number of times a call will be attempted, intervals between retries, maximum call ins and user response time outs. Redial attempts can be used, if the subscriber cannot take the call or the call line is busy.

Voice styles also allow the specification of an answer detection mode, which governs the amount of effort put into detecting whether a subscriber or device is answering the call. According to one aspect of the invention, during creation of a voice style, an answer mode may be selected. For example, various options provided may include answer with full detection, answer with quick detection, and answer with no detection. A default (for example answer with full detection) may be set in the system.

During set up of voice content, an administrator may be presented with a graphical user interface that enables the administration to simulate and view service execution, messages, prompts, options and responses based on clicked entries as if done by the subscriber, using a person key on the touch pad dial simulator. Among other things, the touch pad dial simulator enables an administrator to perform an on-screen test of a telecast, including the ability to click “Person” to examine what the call server will say when a person answers a telecast and click “Device” to examine the message the call server will leave, if a voice answering machine or other device answers the call. In another embodiment of the invention, the administrator may edit the text of a message onscreen while performing a simulation using the graphical user interface.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1a is a flow chart of a method in accordance with an embodiment of the present invention.

FIG. 1b is a flow chart indicating a method of generating a voice service according to one embodiment of the present invention.

FIG. 1c is a flow chart indicating a method for interactive voice broadcasting according to an embodiment of the present invention.

FIG. 2 is a flow chart indicating a sequence of an interactive voice broadcast according to one embodiment of the present invention.

FIG. 3a is a schematic block diagram of a system in accordance with an embodiment of the present invention.

FIG. 3b is a schematic block diagram of an intelligence server according to an embodiment of the present invention.

FIG. 3c is a schematic block diagram of call server according to an embodiment of the present invention.

FIG. 4 is a schematic block diagram of a commercial transaction processing system according to an embodiment of the present invention.

FIG. 5 is a flow chart of a method of using a voice service bureau according to an embodiment of the present invention.

FIG. 6a is a schematic block diagram of a voice service system incorporating a voice service bureau according to one embodiment of the present invention.

FIG. 6b is block diagram of a primary voice bureau according to one embodiment of the present invention.

FIG. 6c is a block diagram of a backup voice bureau according to another embodiment of the present invention.

FIG. 7 is a flow chart illustrating a method for integrating inbound and outbound voice services.

FIG. 8 is a block diagram of a call server configured to provide integrated inbound and outbound voice services.

FIG. 9 illustrates a flow chart of voice service delivery according to the invention.

FIG. 10 illustrates an architecture for authorization of intended voice service recipients according to the invention.

FIG. 11 illustrates a flow chart of voice service delivery according to the invention in another aspect.

FIG. 12 illustrates a flow chart of message processing according to one aspect of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

A description of the overall system and method is set forth in connection with FIGS. 1-8 described below.

According to another aspect of the invention, the message delivered during a telecast may be customized depending on the recipient of the outbound call. For example, if the voice service is one that may involve the delivery of a message containing sensitive information, the subscriber or voice service creator may prefer that such information only be delivered to the actual subscriber and not another person or a device such as an answering machine or phone. During the creation of a voice service or in connection with establishing a user profile (e.g., during a subscriber registration process), criteria may be specified to customize a message depending on the recipient of an outbound call from the voice service system. Authentication may be accomplished by use of a PIN or other input from the recipient, as illustrated in FIG. 3A. Automated recipient detection techniques may also be used. For instance, spectral voice profiles and other speech recognition or biometric techniques may be used to authenticate the person receiving the call.

A flow chart depicting execution of voice service detection according to one embodiment is shown in FIG. 9. Call setup and outbound call delivery is performed as described elsewhere herein, and processing with regard to detection is discussed in connection with the figure. After the preparatory call processing, in step 3002 the call server 18 listens to the call pickup sequence, for instance to detect machine tones (facsimile, answering machine, call forwarding, fax/modem or others) or an offhook signal followed by human voice cadence. In step 3004, the call server 18 determines if the detected recipient is a machine or a person.

If the recipient is a machine of some type, in step 3006 a machine message is delivered or the call may be terminated. On the other hand, if the detected recipient is a person, in step 3008 it is determined whether the recipient may be authenticated, using PIN, voice recognition or other techniques. If the recipient is authenticated, in step 3012 the intended recipient message may be delivered. The outbound voice service then returns to further processing as described elsewhere herein, for instance to prompt for input or terminate processing. If the recipient can not be authenticated as the intended recipient, in step 3010 a secondary authentication is performed, if the subscriber's service profile designates a secondary recipient, or the call may be terminated or other action taken.

A method for detection according to another aspect of the invention is shown in FIG. 10. In step 7002 an administrator creates a voice service using a voice service wizard or otherwise. In step 7004, a voice address is specified, for example, when a subscriber is subscribed. In step 7006, a voice style is assigned to the voice address based on subscriber preferences. In step 7008, the administrator may set an answer detection mode, for instance answer with full detection, answer with quick detection, and answer with no detection. When an answer mode is set for full detection, the call server performs all (or substantially all) possible detections of possible answer statuses. For example the call server may provide the following types of detection once the call is answered: 1) Positive Voice Detection (PVD), e.g, a person's voice; 2) Positive Answering Machine Detection (PAMD); 3) Cadence Detection (CAD); 4) Frequency detection (answering machine tones); or other detection techniques.

The quick detection mode may, for example, not allow the call server to detect an answering machine (PAMD), but instead tries to detect a person by PVD or short cadences, and looks for tones and long cadence to detect devices. Once the call server has detected an answer, it waits for one second to give the receiving party time to start listening. This mode may be used for example when a person picks up the phone, but is detected as a device and therefore only gets to hear the message designed to be left in a voice mail box or other message recording device (device message). This problem may be caused by noise introduced through certain internal telephone switches/voice mail systems, by the microphone of a speaker phone or by high volume noise (for example an air conditioning vent). One way for a subscriber to overcome this problem is to press a key on the telephone while the device message is played. The system detects this a subscriber interaction, restarts an interactive mode and speaks the message designed for a live person.

The answer with no detection mode allows no initial detection and simply assumes that a subscriber will answer the phone and be ready to listen. This answer mode can take advantage of the capability of certain cellular telephones that have an auto answer mode. It can automatically pick up a call without the subscriber having to do anything. After the phone is picked up, the voice service is delivered right away. These and other detection settings are possible in the invention.

After the detection mode is set, in step 7010, the content of the voice message is defined. In step 7012, (when a voice service is executed) the outbound voice message call is initiated. In step 7014, call server 18 listens to the call pickup sequence, for instance to detect machine tones (facsimile, answering machine, call forwarding, fax/modem or others) or an offhook signal followed by human voice cadence as specified by the detection mode. In step 7016, the call server 18 determines if the detected recipient is a machine or person. If the recipient is a machine, in step 7018 a machine message may be delivered, or the call may be terminated.

If the recipient is a person, in step 7020 it is determined whether the recipient may be authenticated. If the recipient can not be authenticated, in step 7022 a secondary authentication may be performed for any designated secondary recipients, or the call may be terminated or other action taken. On the other hand, if the detected recipient is authenticated, in step 7024 the intended recipient message may be delivered. Processing then returns to prompt, terminate or continue in another manner as described herein.

One embodiment of the invention is shown in FIG. 5. In this architecture, a person operating an administrator console 161 may configure a voice delivery service for an individual or other subscriber, for instance by using Service Wizard 1616. In this regard, the personal call settings 1614 may include a flag or indication that customization of service delivery is desired, depending on the recipient. If the subscriber has not arranged for customized delivery, message processing proceeds in the normal fashion.

During call setup as configured by a systems administrator 1611 or otherwise, for subscriber accounts desiring the customized delivery feature, the identity of one or more recipients qualified to received the voice message content may be registered for particular subscribers. The subscriber may for example exclude the delivery of voice message content from type of detected recipient except positive voice detection (PVD), i.e, the subscriber's own voice, thus omitting for instance delivery upon positive answering machine detection (PAMD) or frequency detection (answering machine tones). Other types of recipients may be detected by call server 18 and associated elements shown in FIG. 4, including cellular telephone transmissions, alphanumeric or voice pages, voice box, voice-to-text email conversions, and others.

According to another aspect of the invention, the subscriber may indicate a set of tiers or levels of customized message delivery, differentiated according to the identity of the recipient person or device. For example, the call server 18 illustrated in FIG. 4 may be configured to detect machine tones, human voice frequencies or cadences and other recipient cues as part of user response 1815 or otherwise. When PAMD is detected, for example, the call builder 1813 may respond according to that subscriber's predefined delivery profile by building a message in call builder 1813 operating in conjunction with call database 1811 to abbreviate the outgoing message.

As a result, for instance instead of receipt of an urgent message such as “Mr. Smith, test results suggest that you schedule an immediate visit to your physician” a shorter less descriptive alert, such as “Mr. Smith an important update has been received, please call for more information” or the like may be delivered. If the subscriber so desires, the call server 18 may abort any messages for one or more categories of message content, when anything other than a live pickup by the subscriber has been fully authenticated. For example, the call server 18 may generate an authentication sequence querying a live call pickup for PIN or other information, to assure the identity of the subscriber. In another embodiment, the subscriber may designate one or more secondary recipients with separate PIN or other information, which when validated permits the secondary recipient to received the same or an abbreviated version of the telecast.

Another architecture for the authorization of voice service delivery is shown in FIG. 11. As shown in this figure, an authorization server 5002 interfaces to one of more voice service subscribers 5000 via the public switched telephone network (PSTN) 5014, although wireless and other connections may be used as well. The authorization server 5002 is in communication with voice service bureau 402, described in more detail below, or other content sources for the delivery of customized voice service content related to financial, news or other information programmed for each of the individual subscribers 5000.

Upon the execution of a voice service, the voice service bureau 402 in cooperation with authorization server 5002 generates and prepares a voice message for delivery to one or more of selected subscribers 5000. An outbound call is initiated to telephone or other numbers associated with those subscribers.

After placing the outbound call to the associated telephone number, authentication module 5004 listens to the call pickup sequence to determine the identity of the recipient. The intended recipient may pick up a telephone and greet the caller. The invention in one respect may wait for an offhook signal followed by voice band input, indicating that a person has answered the call. In that instance, the authentication module 5004 may invoke a voice authentication sequence, such as “Ms. Jones we have an important update for you. Please enter your PIN”.

Authentication module 5004 may thus query for a valid personal identification number from the person receiving the call, and perform a lookup of valid PIN or other information against authorization database 5010. If the recipient provides a valid response to the voice authentication sequence, the authorization server 5002 may cooperate with voice service bureau 402 or other voice content sources to deliver the updated financial, medical or other subscribed information without further processing.

In an alternative embodiment, authentication module 5004 may include a voice digitizer circuit to capture spectral and other information concerning the receiving party's voice (positive voice detection), and on that basis or in conjunction with PIN or other information authorize the delivery of the full voice service content.

However, if during the initial call pickup sequence any action other than connection to the intended subscriber is detected, the authentication module 5004 performs alternative processing to adjust the delivery of the voice service content. For instance, if the authentication module 5004 detects an offhook signal followed by the handshaking tones of a facsimile machine (Group III protocol or others), or the tones of a modem or fax/modem device such as in a computer board, or the beep tone or other signal of an answering machine, the invention interrupts the delivery of the voice service message on the assumption that the recipient may not be the subscriber. In this case, the authentication module 5004 processes further information concerning the nature of the person or service receiving the call and adjusts the delivery accordingly.

If for instance an answering machine, fax/modem or other message intake or storage device is detected, the authentication module 5004 may communicate with message selection module 5006 to determine an alternative voice message to deliver. In the case of an answering machine or similar device, message selection module 5006 may consult message tree 5012 to select a brief, discreet message such as “Ms. Jones we have an important update for you, please call us at (800) xxx-xxxx”. The subscriber may thus be alerted that a significant update is awaiting them.

A voice service may be created to handle tiers of message delivery according to the call recipient. For instance, a subscriber may register live calls received by themselves for full content delivery in authorization database 5010, but if the subscriber feels confident that his answering machine is secure may also register pickups by that device delivery for full message content as well.

If the pickup sequence indicates that a person has answered the telephone call, and the person is not the subscriber but someone the subscriber wishes to be able to receive at least some of the content, the subscriber may register secondary recipients in authorization database 5010 with a corresponding PIN for that person, associated with a lower or same degree of content privilege. Voice profile detection may also be used to verify the secondary recipient, in conjunction with adaptive menu module 5008 to correlate voice prompts with categories of recipient, for example. For instance a person's spouse or relative may be authorized to receive the full message content for one or more categories of service, after PIN or other authentication.

Message tree 5012 may for example include message entries such as “This is a message for Ms. Jones, her portfolio indicates significant activity requiring her attention, please have her call (800) xxx-xxxx” for trusted secondary recipients. In another embodiment the subscriber may program the invention to selectively update, suspend or otherwise edit the delivery profile and degree of access authorization via authorization database 5010 at any time, for instance remotely by keypad entry.

With reference to FIG. 12, a flow chart of message processing according to one aspect of the invention is described. In step 6002, a voice service telecast to one of the subscribers 5000 is initiated. In step 6004, the system determines the recipient. for instance, by tone identification, voice identification, PIN validation or other means. In step 6006, the authorization level of the recipient is determined by a lookup on authorization database 5010 or otherwise.

In step 6008, the message content corresponding to the authorization level of the recipient is retrieved from message tree 5012 or otherwise. In step 6010, the voice service message is broadcast to the recipient. In step 6012, the recipient is polled for input if necessary, and control is returned to step 6008 if the input so indicates. For instance, the invention may query the recipient “Enter 1 to receive detailed fund information” after delivery of a financial update. If no further input or broadcasting is necessary, in step 6014 processing ends or other action taken.

According to one embodiment of the present invention, a system is provided for automatic, interactive, real-time, voice transmission of OLAP output to one or more subscribers. For example, subscribers may be called by the system, and have content delivered audibly over the telephone or other voice-enabled terminal device. During the IVB, information may be exchanged between the system and a subscriber. The system conveys content to the subscriber and, the subscriber may respond by pressing one or more buttons on a telephone touch pad dial (or other input mechanism) to hear more information, to exercise options, or to provide other responses. This interaction shapes the structure of a basic exchange between the system and the subscriber. During or after the call is terminated, the subscriber's responses may be stored and processed (e.g., by other applications).

According to one embodiment of the present invention, a method for automatic, interactive, real-time, voice transmission of OLAP output to one or more subscribers is provided. FIG. 1a depicts a flow chart of a method for automatic, interactive, real-time, voice transmission of OLAP output according to one embodiment. The method begins in step 110 with the creation of a voice service (e.g., by a system administrator or user). A voice service is created using, for example, a voice service wizard which may comprise a series of interfaces. One embodiment of a method for creating a voice service is explained in more detail below in conjunction with FIG. 1b. One embodiment of a voice service wizard is explained below in conjunction with FIG. 3b.

After a voice service is created, users may subscribe or be subscribed to the voice service (step 120), for example, by using a subscription interface. According to one embodiment, users may subscribe to an existing voice service over the telephone or by web-based subscription. A user may also be subscribed programmatically. In other embodiments, a user may subscribe to a voice service via electronic mail. Not every voice service created in step 110 is available for subscription. More specifically, according to another embodiment, only a user with appropriate access, such as the creator of the service, is allowed to subscribe himself or others to a service. Such a security feature may be set when the voice service is created.

In step 130, a scheduling condition or other predetermined condition for the voice services is monitored to determine when they are to be executed. That is, when a voice service is created or subscribed to, the creator or user specifies when the voice service is to be executed. A user may schedule a voice service to execute according to the date, the time of day, the day of the week, etc. and thus, the scheduling condition will be a date, a time, or a day of the week, either one time or on a recurring basis. In the case of an alert service, discussed in more detail below, the scheduling condition will depend on satisfaction of one or more conditions. According to one embodiment, the condition(s) to be satisfied is an additional scheduling condition. According to another embodiment, to another embodiment, a service may be executed “on command” either through an administrator or programmatically through an API. Scheduling of voice services is discussed in more detail below.

The method continues monitoring the scheduling condition for voice services until a scheduling condition is met. When a scheduling condition is met, that voice service is executed. The execution of a voice service involves, inter alia, generating the content for the voice service, and structuring the voice service to be telecast through a call server. The execution of a voice service is explained in detail in conjunction with FIG. 1c.

An example of a telecast is as follows.

PERSONALIZED GREETING

Hello Joe, this is your stock update.

PIN VERIFICATION

Please enter your six digit PIN number

(Joe enters his PIN, using the keypad dial on his telephone.)

MENU OPTIONS

Your portfolio was up by $1000 today.

Please select:

1. To get a portfolio stock update

2. To conduct a transaction

(Joe presses 2)

SUB MENU

Thank you, Joe! Please select a ticker.

1. PQT

2. TQP

3. Listen to options again

4. Return to main menu

(Joe presses 1.)

SUB MENU

Would you like to buy or sell stock? Please press:

1. To sell stock

2. To buy stock

(Joe Presses 1.)

SUB MENU

How many shares of PQT would you like to sell today? Please press:

1. To sell 50 shares

2. To sell 100 shares

3. To sell 200 shares

4. To sell another quantity

(Joe presses 2.)

SUB MENU

You selected 2. You want to sell 100 shares of PQT. Please press:

1. If this is correct

2. If this is incorrect

3. If you want to change the number of shares you want to buy.

(Joe presses 1.)

END VOICE SERVICE/TERMINATE TELECAST

Thank you for using our voice interactive broadcasting service, Joe. We will call you back when your transaction is completed. Good-bye.

As can be seen from the above sample during an IVB, the user is presented with information, e.g., the status of his portfolio, and is presented options related to that report, e.g., the option to buy or sell stock.

According to one embodiment, a voice service is constructed using service wizard. A voice service is constructed using several basic building blocks, or elements, to organize the content and structure of a call. According to one embodiment, the building blocks of a voice service comprise elements of a markup language. According to one particular embodiment, elements of a novel markup language based on XML (TML) are used to construct voice services. Before explaining how a telecast is constructed, it will be helpful to define these elements.

The DIALOG element is used to define a unit of interaction between the user and the system and it typically contains one or more of the other elements. A DIALOG can not be contained in another element.

The SPEECH element is used to define text to be read to a user.

The INPUT element is used to define a section of a DIALOG that contains interactive elements, i.e., those elements that relate to a response expected from a user and its validation. An INPUT element may contain OPTION, PROMPT and ERROR elements.

An OPTION element identifies a predefined user selection that is associated with a particular input. According to one embodiment, OPTION elements are used to associate one or more choices available to a user with telephone keys.

A PROMPT element defines a particular input that is expected. According to one embodiment, a PROMPT element defines that a sequence or number of key presses from a telephone keypad is expected as input. Unlike an OPTION Element, a PROMPT Element is not associated with predefined user selections.

The PROMPT and OPTION elements may also be used to request user input using natural language. According to one embodiment, speech recognition technology is used to enable a user to respond to a PROMPT element or to select an OPTION element verbally by saying a number, e.g., “one.”. The verbal response is recognized and used just as a keypress would be used. According to another embodiment, the user may provide a free form verbal input. For example, a PROMPT element may request that a user enter, e.g., the name of a business. In response the user speaks the name of a business. That spoken name is then resolved against predetermined standards to arrive at the input. Word spotting and slot filling may also be used in conjunction with such a PROMPT to determine the user input. For example, a PROMPT may request that the user speak a date and time, e.g., to choose an airline flight or to make a restaurant reservation. The user's spoken response may be resolved against known date and time formats to determine the input. According to another embodiment, a PROMPT is used to request input using natural language. For instance, in conjunction with a voice service to be used to make travel plans, instead of having separate PROMPT elements request input for flight arrival, departure dates and locations, a single natural language PROMPT may ask, “Please state your travel plan.” In response, the user states ‘I'd like to go from Washington D.C. to New York city on the 3^rd of January and return on the 3^rd of February. This request would be processed using speech recognition and pattern matching technology to derive the user's input.

The ERROR element is used to define the behavior of the system if a user makes an invalid response such as touching a number that has not been associated with an OPTION element, or entering input that does not meet the criteria of a PROMPT element. A SYS-ERROR element defines a handler for certain events, such as expiration of the waiting time for a user response.

The FOR-EACH element is used to direct the system to loop through a list of variables e.g., variables contained in a database report, or variables from a user input, to dynamically generate speech from data.

In addition to the elements described above, there are two features that maximize an administrator's ability to design voice services. Call Flow Reports enable an administrator to generate the structure of a call based on the content of an report e.g., from an OLAP system or other data repository. For example, the options presented to a user in a PROMPT element may be made to correspond to the row of a data report. According to one embodiment, report data is converted into options by application of an XSL (extensible style sheet language) style sheet. The result of this application is inserted into the static call structure when the voice service is executed.

The use of an XSL style sheet is a feature that maximizes an administrator's voice service building ability. As discussed above, they are used to create dynamic call structure that depends on data report output. They may also be used to generate a text string that comprises the message to be read to a user at any point in a call.

A method for creating a voice service according to one embodiment will now be explained in conjunction with FIG. 2. The method begins in step 210 by naming the voice service. Then, in step 220 various scheduling parameters of the voice service are defined. In step 250 the service content is defined. And, in step 260, the personalization modes, or style properties are selected for the voice service.

According to one embodiment, in step 210, a voice service is named and a description of the voice service provided. By providing a name and description, a voice service may be uniquely identified. An interface is provided for prompting input of the name of the service to be created or edited. An input may also be provided for a written description. An open typing field would be one option for providing the description input. According to another embodiment, if an existing call service has been selected to edit, the service name field may not be present or may not allow modification.

In step 220, conditions for initiating the service are selected. This may include selecting and defining a service type. At least two types of services may be provided based on how the services are triggered. A first type of service is run according to a predetermined schedule and output is generated each time the service is run. A second type of service, an alert service, is one that is run periodically as well, however, output is only generated when certain criteria is satisfied. Other service types may be possible as well. In one embodiment the administrator is prompted to choose between a scheduled service or an alert service. An interface may provide an appropriate prompt and some means for selecting between a scheduled service and an alert service. One option for providing the input might be an interface with a two element toggle list.

In one embodiment, a set of alert conditions is specified to allow the system to evaluate when the service should be initiated if an alert type service has been selected. In one embodiment, a report or a template/filter combination upon which the alert is based is specified. Reports and template/filter combinations may be predefined by other objects in the system including an agent module or object creation module. According to one embodiment, an agent module, such as DSS Agent™ offered by MicroStrategy, may be used to create and define reports with filters and template combinations, and to establish the alert criteria for an alert service. According to another embodiment, an interface is be provided which includes a listing of any alert conditions presently selected for the voice service. According to this embodiment, the interface may comprise a display window. A browse feature may take the user to a special browsing interface configured to select a report or filter-template combination. One embodiment of an interface for selecting reports and filter-template combinations is described below. Once a report or filter and template combination is chosen, the alerts contained in the report or filter and template combination may be listed in the display window of the interface.

In step 220, the schedule for the service is also selected. According to one embodiment, predefined schedules for voice services may be provided or a customized schedule for the voice service may be created. If a new schedule is to be created, a module may be opened to enable the schedule name and parameters to be set. Schedules may be run on a several-minute, hourly, daily, monthly, semi-annual, annual or other bases, depending upon what frequency is desired. According to one embodiment, an interface is provided that allows the administrator to browse through existing schedules and select an appropriate one. The interface may provide a browsing window for finding existing schedule files and a “new schedule” feature which initiates the schedule generating module. In one embodiment, schedules may not be set for alert type services. However, in some embodiments, a schedule for evaluating whether alert conditions have been met may be established in a similar manner.

In step 230, the duration of the service is also set. Service duration indicates the starting and stopping dates for the service. Setting a service duration may be appropriate regardless of whether a scheduled service or alert type service has been selected. The start date is the base line for the scheduled calculation, while the end date indicates when the voice service will no longer be sent. The service may start immediately or at some later time. According to one embodiment, the interface is provided to allow the administrator to input start and end dates. The interface may also allow the administrator to indicate that the service should start immediately or run indefinitely. Various calendar features may be provided to facilitate selection of start and stop dates. For example, a calendar that specifies a date with pull-down menus that allow selection of a day, month and year may be provided according to known methods of selecting dates in such programs as electronic calendar programs and scheduling programs used in other software products. One specific aid that may be provided is to provide a calendar with a red circle indicating the present date and a blue ellipse around the current numerical date in each subsequent month to more easily allow the user to identify monthly intervals. Other methods may also be used.

In step 220, a voice service may also be designated as a mid-tier slicing service. In one embodiment, mid-tier slicing services generate content and a dynamic subscriber list in a single query to an OLAP system. According to one embodiment, in a mid-tier slicing service a single database query is performed for all subscribers to the service. The result set developed by that query is organized in a table that contains a column that indicates one or more users that each row of data is applicable to.

In step 250, the content of the voice service is defined. Defining the content of the voice service may include selecting the speech to be delivered during the voice service broadcast (content), the structure of dialogs, menus, inputs, and the background procedures which generate both content and structure. In one embodiment, defining voice service content establishes the procedures performed by the vss server to assemble one or more active voice pages in response to initiation of the voice service. According to one embodiment, defining service content involves establishing a hierarchical structure of TML elements which define the structure and content of a voice service. All of the elements in a given service may be contained within a container.

The personalization type is selected in step 260. Personalization type defines the options that the administrator will have in applying personalization filters to a voice service. According to one embodiment, a personalization filter is a set of style properties that can be used to determine what content generated by the service will be delivered to the individual user and in what format it will be delivered. In one embodiment, personalizing the delivery format may include selection of style properties that determine the sex of the voice, the speed of the voice, the number of call back attempts, etc. Personalization filters may exist for individual users, groups of users, or types of users. According to one embodiment, personalization filters may be created independent of the voice service. According to this embodiment, a voice service specifies what filters are used when generating IVBs. Some personalization type options may include: allowing no personalization filters; allowing personalization filters for some users, but not requiring them; and requiring personalization filters for all interactive voice broadcasts made using the service.

According to one embodiment, specifying personalization type is accomplished by administrator input through an interface. The interface may offer a toggle list with the three options: required personalization, optional personalization, and no personalization.

The voice service may be stored in a database structure to enable users to retrieve predefined voice services and to subscribe to these services, for example, through subscription interfaces explained in conjunction FIGS. 3a-3c or otherwise. An interface informing the administrator that creation of the voice service is complete may also be provided.

According to one embodiment, the method of FIG. 1b also comprises an error condition step. An error condition step may be used to enable administrators to specify “error” conditions and the handling of those conditions. For example, an “error” condition may comprise a notification that a server is “down” or that there is no data to be returned. An administrator may specify particular actions to be performed by the system in response to one or more error conditions. For example, an administrator may specify an “addressing” error (e.g., disconnected number) and indicate a particular action to be performed in response to an “addressing” error (e.g., notify system administrator). Other error conditions might include: an alert report encountering an error and returning no data; a subscriber lacking the required personalization filter for the service; errors occurring in the generation of one or more reports; or reports returning no data. Various other conditions and actions may be specified. Certain error conditions may be predetermined for the system, but an administrator may have reasons for supplementing or diverging from the predetermined error conditions. According to one particular embodiment, error conditions are specified using the ERROR and SYS-ERROR elements.

In one embodiment, setting error conditions may be accomplished using an error handling interface. The interface may allow the administrator to select either default error handling, or to customize error handling using a module for defining error handling. If default handling is selected, the system uses established settings. If customized handling is chosen, the user may use a feature to access the appropriate interface for the error handling module.

Servers may have limited capacity to perform all of the actions required of them simultaneously, the method of FIG. 1b comprises a step for prioritizing the execution and delivery of voice services. Prioritization may establish the order in which the voice service system allocates resources for processing voice service and delivering the IVB. According to one embodiment, assigning priority to a voice service establishes priority for queries to the database system, formatting the voice service, or IVBs. Any criteria may be used for establishing priority. According to one embodiment, priority is established based on service content. According to another embodiment, priority is based on service destination. According to another embodiment, priority may be established based on the type of voice service, i.e., alert v. scheduled. Any number of procedures or criteria for denoting relative importance of service delivery may be established.

In one embodiment, an interface is provided for defining the priority of the voice service being created or edited. According to one embodiment, the interface comprises a screen including option boxes with pull down menus listing the number of different prioritization options.

Another aspect of the invention relates to a method for executing a voice service. FIG. 1c depicts one example of a flow chart for executing a voice service. In step 310, the content of a voice service is generated. In step 320, the call structure of a telecast is created via Active Voice Pages. In step 330, the AVPs are put in a call database for processing e.g., in a call queue. In step 340, the call request is processed and an interactive voice broadcast with the user is implemented. In step 350, user's responses are written back to the voice service system (e.g., the Active Voice Page). Each of these steps will be explained in more detail below.

According to one embodiment, content is created in step 310 as follows. A voice service execution begins by running scheduled reports, queries or by taking other action to determine whether the service should be sent. The subscribers for the service are then resolved. Datasets are generated for each group of subscribers that has unique personalization criteria.

Call structure may be created (step 320) as follows. An AVP contains data at various hierarchical content levels (nodes) that can be either static text or dynamic content. Static text can be generated e.g., by typing or by incorporating a text file. Dynamic content may be generated e.g., by inserting data from a data report using a grid an/or an XSL stylesheet. Moreover, content is not limited to text based information. Other media, such as, sound files, may be incorporated into the AVP. The call data (for example, at a particular level) may be the text that is converted to speech and played when the recipient encounters the node.

According to another embodiment, call content may include “standard” active voice pages that are generated and inserted into a database or Web Server where the pages are periodically refreshed. According to one particular embodiment, the active voice page that is generated for a user contains links to these standard active voice pages. The links may be followed using a process similar to web page links.

The call structure may comprise either a static structure that is defined in the voice service interfaces e.g., by typing text into a text box and/or a dynamic structure generated by grid/XSL combinations. The dynamic structure is merged with static structure during the service execution. A single call structure is created for each group of users that have identical personalization properties across all projects because such a group will receive the same content.

After a call structure is generated, in step 330, it is sent to a call database e.g., call database 1811 shown in FIG. 3c along with the addresses and style properties of the users. The style properties govern the behavior of a call server 18 in various aspects of the dialog with a user. Call server 18 queries call database 1811 for current call requests and places new call requests in its queue.

In step 340, a call request is processed. A call is implemented on call server 18 using one of several ports that are configured to handle telephone communication. When a port becomes available, the call request is removed from the queue and the call is made to the user. As the user navigates through an active voice page, e.g., by entering input using the key pad or by speaking responses, call/content is presented by converting text to speech in text-to-speech engine 1814. User input during the call may be stored for processing. According to another embodiment, user responses and other input may also be used to follow links to other active voice pages. For example, as explained above, “standard” active voice pages may be generated and inserted into a database or Web Server. Then, when a user's voice service is delivered, that voice service may contain links to information that may be accessed by a user. A user may access those standard active voice pages by entering input in response to OPTION or PROMPT elements.

In step 350, user responses are stored by the system. According to one embodiment, user responses are stored in a response collection defined by the active voice page. A voice service may specify that a subscriber return information during an IVB so that another application may process the data. For instance, a user may be prompted to purchase a commodity and be asked to enter or speak the number of units for the transaction. During or after an IVB, the subscriber's responses are written to a location from which they can be retrieved for processing (e.g., by an external application).

FIG. 2 is an example of an IVB with interactive call flow. An IVB usually contains a greeting message that addresses the targeted user, identifies the name of the calling application, and states the purpose of the call and/or presents summary metrics. The voice service system can also implement a PIN verification protocol, if this layer of security is required. The main menu structure of an IVB can contain a number of options that lead to sub-menu structures. A menu can also contain prompts for the user to enter numerical information using a telephone touch pad dial. A node along the hierarchical menu structure may have options to return the user to a higher level.

FIG. 3a depicts an embodiment of a system according to one embodiment of the present invention. Preferably, the system comprises database system 12, a DSS server 14, voice server 16, a call server 18, subscription interface 20, and other out input/files 24.

Database system 12 and DSS server 14 comprise an OLAP system that generates user-specified reports from data maintained by database system 12. Database system 12 may comprise any data warehouse or data mart as is known in the art, including a relational database management system (“RDBMS”), a multidimensional database management system (“MDDBMS”) or a hybrid system. DSS server 14 may comprise an OLAP server system for accessing and managing data stored in database system 12. DSS server 14 may comprise a ROLAP engine, MOLAP engine or a HOLAP engine according to different embodiments. Specifically, DSS server 14 may comprise a multithreaded server for performing analysis directly against database system 12. According to one embodiment, DSS server 14 comprises a ROLAP engine known as DSS Server™ offered by MicroStrategy.

Voice service server (VSS) 16, call server 18 and subscription interface 20 comprise a system through which subscribers request data and reports e.g., OLAP reports through a variety of ways and are verbally provided with their results through an IVB. During an IVB, subscribers receive their requested information and may make follow-up requests and receive responses in real-time as described above. Although the system is shown, and will be explained, as being comprised of separate components and modules, it should be understood that the components and modules may be combined or further separated. Various functions and features may be combined or separated

Subscription interface 20 enables users or administrators of the system to monitor and update subscriptions to various services provided through VSS 16. Subscription interface 20 includes a world wide web (WWW) interface 201, a telephone interface 202, other interfaces as desired and a subscriber API 203. WWW interface 201 and telephone interface 202 enable system 100 to be accessed, for example, to subscribe to voice services or to modify existing voice services. Other interfaces may be used. Subscriber API 203 provides communication between subscription interface 20 and VSS 16 so that information entered through subscription interface 20 is passed through to VSS 16.

Subscription interface 20 is also used to create a subscriber list by adding one or more subscribers to a service. Users or system administrators having access to VSS 16 may add multiple types of subscribers to a service such as a subscriber from either a static recipient list (SRL) (e.g., addresses and groups) or a dynamic recipient list (DRL) (described in further detail below). The subscribers may be identified, for example, individually, in groups, or as dynamic subscribers in a DRL. Subscription interface 20 permits a user to specify particular criteria (e.g., filters, metrics, etc.) by accessing database system 12 and providing the user with a list of available filters, metrics, etc. The user may then select the criteria desired to be used for the service. Metadata may be used to increase the efficiency of the system.

A SRL is a list of manually entered names of subscribers of a particular service. The list may be entered using subscription interface 20 or administrator console 161. SRL entries may be personalized such that for any service, a personalization filter (other than a default filter) may be specified. A SRL enables different personalizations to apply for a login alias as well. For example, a login alias may be created using personalization engine 1632. Personalization engine 1632 enables subscribers to set preferred formats, arrangements, etc. for receiving content. The login alias may be used to determine a subscriber's preferences and generate service content according to the subscriber's preferences when generating service content for a particular subscriber.

A DRL may be a report which returns lists of valid user names based on predetermined criteria that are applied to the contents of a database such as database system 12. Providing a DRL as a report enables the DRL to incorporate any filtering criteria desired, thereby allowing a list of subscribers to be derived by an application of a filter to the data in database system 12. In this manner, subscribers of a service may be altered simply by changing the filter criteria so that different user names are returned for the DRL. Similarly, subscription lists may be changed by manipulating the filter without requiring interaction with administrator console 161. Additionally, categorization of each subscriber may be performed in numerous ways. For example, subscribers may be grouped via agent filters. In one specific embodiment, a DRL is created using DSS Agent™ offered by MicroStrategy.

VSS 16 is shown in more detail in FIG. 3b. According to one embodiment, VSS 16 comprises administrator console 161, voice service API 162 and backend server 163. Administrator console 161 is the main interface of system 100 and is used to view and organize objects used for voice broadcasting. Administrator console 161 provides access to a hierarchy of additional interfaces through which a system administrator can utilize and maintain system 100. Administrator console 161 comprises system administrator module 1611, scheduling module 1612, exceptions module 1613, call settings module 1614, address handling module 1615, and service wizard 1616.

System administrator module 1611 comprises a number of interfaces that enable selection and control of the parameters of system 100. For example, system administrator module 1611 enables an administrator to specify and/or modify an email system, supporting servers and a repository server with which system 100 is to be used. System administrator 1611 also enables overall control of system 100. For example, system administrator module is also used to control the installation process and to start, stop or idle system 100. According to one embodiment, system administrator 1611 comprises one or more graphical user interfaces (GUIs).

Scheduling module 1612 comprises a number of interfaces that enable scheduling of voice services. Voice services may be scheduled according to any suitable methodology, such as according to scheduled times or when a predetermined condition is met. For example, the predetermined condition may be a scheduled event (time-based) including, day, date and/or time, or if certain conditions are met. In any event, when a predetermined condition is met for a given service, system 100 automatically initiates a call to the subscribers of that service. According to one embodiment, scheduling module 1612 comprises one or more GUIs.

Exceptions module 1613 comprises one or more interfaces that enable the system administrator to define one or more exceptions, triggers or other conditions. According to one embodiment, exceptions module 1613 comprises one or more GUIs.

Call settings module 1614 comprises one or more interfaces that enable the system administrator to select a set of style properties for a particular user or group of users. Each particular user may have different options for delivery of voice services depending on the hardware over which their voice services are to be delivered and depending on their own preferences. As an example of how the delivery of voice services depends on a user's hardware, the system may deliver voice services differently depending on whether the user's terminal device has voice mail or not. As an example of how the delivery of voice services depends on a user's preferences, a user may chose to have the pitch of the voice, the speed of the voice or the sex of the voice varied depending on their personal preferences. According to one embodiment, call settings module 1614 comprises one or more GUIs.

Address handling module 1615 comprises one or more interface that enable a system administrator to control the address (e.g., the telephone number) where voice services content is to be delivered. The may be set by the system administrator using address handling module 1615. According to one embodiment, address handling module 1615 comprises one or more GUIs.

Voice service wizard module 1616 comprises a collection of interfaces that enable a system administrator to create and/or modify voice services. According to one embodiment, service wizard module 1616 comprises a collection of interfaces that enable a system administrator to define a series of dialogs that contain messages and inputs and determine the call flow between these dialogs based on selections made by the user. The arrangement of the messages and prompts and the flow between them comprises the structure of a voice service. The substance of the messages and prompts is the content of a voice service. The structure and content are defined using service wizard module 1616.

Voice service API 162 (e.g., MicroStrategy Telecaster Server API) provides communication between administrator console 161 and backend server 163. Voice Service API 162 thus enables information entered through administrator console 161 to be accessed by backend server 163 (e.g., MicroStrategy Telecaster Server).

Backend server 163 utilizes the information input through administrator console 161 to initiate and construct voice services for delivery to a user. Backend server 163 comprises report formatter 1631, personalization engine 1632, scheduler 1633 and SQL engine 1634. According to one embodiment, backend server 163 comprises MicroStrategy Broadcast Server. Report formatter 1631, personalization engine 1632, and scheduler 1633 operate together, utilizing the parameters entered through administrator console 161, to initiate and assemble voice services for transmission through call server 18. Specifically, scheduler 1633 monitors the voice service schedules and initiates voice services at the appropriate time. Personalization engine 1632 and report formatter 1631 use information entered through service wizard 1616, exceptions module 1613, call settings module 1614, and address module 1615, and output provided by DSS server 14 to assemble and address personalized reports that can be sent to call server 18 for transmission. According to one embodiment, report formatter 1631 includes an XML based markup language engine to assemble the voice services. In a particular embodiment, report formatter includes a Telecaster Markup Language engine offered by MicroStrategy Inc. to assemble the call content and structure for call server 18.

SQL engine 1634 is used to make queries against a database when generating reports. More specifically, SQL engine 1634 converts requests for information into SQL statements to query a database.

Repository 164 may be a group of relational tables stored in a database. Repository 164 stores objects which are needed by system 100 to function correctly. More than one repository can exist, but preferably the system 100 is connected to only one repository at a time.

According to one embodiment, a call server 18 is used to accomplish transmission of the voice services over standard telephone lines. Call server 18 is shown in more detail in FIG. 3c. According to one embodiment, call server 18 comprises software components 181 and hardware components 182. Software components 181 comprise call database 1811, mark-up language parsing engine 1812, call builder 1813, text-to-speech engine 1814, response storage device 1815 and statistic accumulator 1816.

Call database 1811 comprises storage for voice services that have been assembled in VSS 16 and are awaiting transmission by call server 18. These voice services may include those awaiting an initial attempt at transmission and those that were unsuccessfully transmitted (e.g., because of a busy signal) and are awaiting re-transmission. According to one embodiment, call database 1811 comprises any type of relational database having the size sufficient to store an outgoing voice service queue depending on the application. Call database 1811 also comprises storage space for a log of calls that have been completed.

Voice services stored in call database 1811 are preferably stored in a mark-up language. Mark-up language parsing engine 1812 accepts these stored voice services and separates the voice services into parts. That is, the mark-up language version of these voice services comprises call content elements, call structure elements and mark-up language instructions. Mark-up language parsing engine 1812 extracts the content and structure from the mark-up language and passes them to call builder 1813.

Call builder 1813 is the module that initiates and conducts the telephone call to a user. More specifically, call builder dials and establishes a connection with a user and passes user input through to markup language parsing engine 1812. In one embodiment, call builder 1813 comprises “Call Builder” software available from Call Technologies Inc. Call builder 1813 may be used for device detection, line monitoring for user input, call session management, potentially transfer of call to another line, termination of a call, and other functions.

Text-to-speech engine 1814 works in conjunction with mark-up language parsing engine 1812 and call builder 1813 to provide verbal communication with a user. Specifically, after call builder 1813 establishes a connection with a user, text-to-speech engine 1814 dynamically converts the content from mark-up language parsing engine 1812 to speech in real time.

A voice recognition module may be used to provide voice recognition functionality for call server 181. Voice recognition functionality may be used to identify the user at the beginning of a call to help ensure that voice services are not presented to an unauthorized user or to identify if a human or machine answers the call. This module may be a part of call builder 1813. This module may also be used to recognize spoken input (say “one” instead of press “1”), enhanced command execution (user could say “transfer money from my checking to savings”), enhanced filtering (instead of typing stock symbols, a user would say “MSTR”), enhanced prompting, (saying numeral values).

User response module 1815 comprises a module that stores user responses and passes them back to intelligence server 16. Preferably, this is done within an AVP. During a telephone call, a user may be prompted to make choices in response to prompts by the system. Depending on the nature of the call, these responses may comprise, for example, instructions to buy or sell stock, to replenish inventory, or to buy or rebook an airline flight. User response module 1815 comprises a database to store these responses along with an identification of the call in which they were given. The identification of the call in which they were given is important to determining what should be done with these responses after the call is terminated. User responses may be passed back to intelligence server 16 after the call is complete. The responses may be processed during or after the call, by the system or by being passed to another application.

Statistics accumulator 1816 comprises a module that accumulates statistics regarding calls placed by call builder 1813. These statistics including, for example, the number of times a particular call has been attempted, the number of times a particular call has resulted in voice mail, the number of times a user responds to a call and other statistics, can be used to modify future call attempts to a particular user or the structure of a voice service provided to a particular user. For example, according to one embodiment, statistics accumulator 1816 accumulates the number of times a call has been unsuccessfully attempted by call builder 1813. This type of information is then used by call server 18 to determine whether or not the call should be attempted again, and whether or not a voice mail should be left.

Call server 18 also comprises certain hardware components 182. As shown in FIG. 1c, hardware components 182 comprise processor 1821 and computer telephone module 1822. According to one embodiment, processor 1821 comprises a Pentium II processor, available from Intel, Inc. Module 1822 provides voice synthesis functionality that is used in conjunction with Text to Speech engine 1814 to communicate the content of voice services to a user. Module 1822 preferably comprises voice boards available from Dialogic, Inc. Other processors and voice synthesizers meeting system requirements may be used.

The system and method of the present invention may form an integral part of an overall commercial transaction processing system.

According to one embodiment of the present invention, a system and method that enable closed-loop transaction processing are provided. The method begins with the deployment of an IVB by executing a service. As detailed above, this includes generating the content and combining this with personalization information to create an active voice page. Call server 18 places a call to the user. During the call, information is delivered to the user through a voice-enabled terminal device (e.g., a telephone or cellular phone).

During the IVB, a user may request a transaction, service, further information from the database or other request, e.g., based on options presented to the user. These will generically be referred to as transactions. The request may be, but is not necessarily, based on or related to information that was delivered to the user. According to one embodiment, the request comprises a user response to a set of options and/or input of information through a telephone keypad, voice input or other input mechanism. According to another embodiment, the request can be made by a user by speaking the request. Other types of requests are possible.

According to one embodiment, the user responses are written to a response collection, which along with information stored in the active voice page, can be used to cause a selected transaction to be executed. According to one embodiment, the active voice page comprises an XML-based document that includes embedded, generic requests, e.g., a request for a transaction, or a request for additional information (a database query). These embedded requests are linked with, for example option statements or prompts so that when a user enters information, the information is entered into the generic request and thus completes a specific transaction request. For example, in the example if a user exercises an option to buy a particular stock, that stock's ticker symbol is used to complete a generic “stock buy” that was embedded in the active voice page.

According to one embodiment, tokens are used to manage user inputs during the IVB. A token is a temporary variable that can hold different values during an IVB. When a user enters input, it is stored as a token. The token value is used to complete a transaction request as described above. According to one embodiment, the system maintains a running list of tokens, or a response collection, during an IVB.

In order to complete the requested transaction, the user responses (and other information from the active voice page) may need to be converted to a particular format. The format will depend, for example, on the nature and type of transaction requested and the system or application that will execute the transaction. For example, a request to purchase goods through a web-site may require the information to be in HTML/HTTP format. A request for additional information may require and SQL statement. A telephone-based transaction may require another format.

Therefore, the transaction request is formatted. According to one embodiment, the transaction is formatted to be made against a web-based transaction system. According to another embodiment, the transaction request is formatted to be made against a database. According to another embodiment, the transaction is formatted to be made against a telephone-based transaction system. According to another embodiment, the transaction is formatted to be made via e-mail or EDI. Other embodiments are possible.

In one embodiment, the formatted transaction request comprises an embedded transaction request. The system described in connection with FIGS. 1-3 provides interactive voice services using TML, a markup language based on XML. Using TML active voice pages are constructed that contain the structure and content for a interactive voice broadcast including, inter alia, presenting the user with options and prompting the user for information. Moreover in connection with OPTION and PROMPT elements, active voice pages also can include embedded statements such as transaction requests. Therefore, the formatting for the transaction request can be accomplished ahead of time based on the particular types of transactions the user may select.

For example, in connection with an exemplary stock purchase, an active voice page can include an embedded transaction request to sell stock in the format necessary for a particular preferred brokerage. The embedded statement would include predefined variables for the name of the stock, the number of shares, the type of order (market or limit, etc.), and other variables. When the user chooses to exercise the option to buy or sell stock, the predefined variables are replaced with information entered by the user in response to OPTION or PROMPT elements. Thus, a properly formatted transaction request is completed.

In the system of FIGS. 1-3, TML parsing engine in call server 18 includes the functionality necessary to generate the properly formatted transaction request as described above. For example, in connection with the embodiment described above, the TML parsing engine shown in FIG. 3c reads the active voice pages. When the TML parsing engine reads an OPTION element that includes and embedded transaction request, it stores the transaction request, and defines the necessary variables and variable locations. When the user exercises that OPTION, the user's input is received by the TML parsing engine and placed at the memory locations to complete the transaction request This technique could be used, for example, to generate a formatted transaction request for web-site.

According to another embodiment, where the transaction request is made via a natural language, voice request, a formatted transaction request can be generated in a number of ways. According to one embodiment, speech recognition technology is used to translate the user's request into text and parse out the response information. The text is then used to complete an embedded transaction request as described above. According to another embodiment, speech recognition software is used to translate the request to text. The text is then converted to a formatted request based on a set of known preferences.

A connection is established with the transaction processing system. This can be accomplished during, or after the IVB. According to one embodiment, the transaction processing system comprises a remotely located telephone-based transaction site. For example, in the system shown in FIGS. 1-3, call server 18, through the TML parsing engine 1812, establishes a connection with a telephone-based transaction processing site.

According to another embodiment, the transaction processing system comprises a remotely based web-site. According to this embodiment, the formatted request includes a URL to locate the web-site and the system accesses the site through a web connection using the formatted request. Alternatively, the formatted request includes an e-mail address and the system uses any known email program to generate an e-mail request for the transaction.

After the connection is established, the transaction is processed by the transaction processing site and the user is notified of the status of the transaction. If the transaction is completed in real-time, the user may be immediately notified. If the transaction is executed after the IVB, the user may be called again by the system, sent an e-mail, or otherwise notified when the transaction has been completed.

According to one particular embodiment, the system comprises the interactive voice broadcasting system shown and described in FIGS. 1-3 and the transaction is accomplished in real-time. In this embodiment, confirmation of the transaction is returned to TML parsing engine 1812 shown in FIG. 3 and translated to speech in text-to-speech engine 1814 and presented to the user during the IVB. More specifically, and similar to the process described with respect to embedded formatted transaction requests, TML also enables embedding of a response statement. Thus, when the transaction is processed and confirmation of the transaction is returned to the system, an embedded confirmation statement is conveyed to the user through TML parsing engine 1812 after being converted to speech in text-to-speech engine 1814.

FIG. 4 schematically depicts one example of how the system and method of the present invention would fit into such a commercial transaction processing system. Working from left to right in FIG. 4, the system begins and ends with information stored in relational databases. One of the primary purposes of information is in making decisions. Thus, the information in the databases is most useful if provided to someone who desires it in a timely fashion.

A voice service system is provided to enable access to the information in the databases. The voice service system utilizes personalization information and personalized menus to construct AVPs pages that enable the information to be delivered to a user verbally. Moreover, the AVPs pages, not only enable information to be presented to the user. But, they also enable the user to provide information back to the voice service system for additional processing.

According to the embodiment shown in FIG. 4, once the AVPs are constructed by voice service system, they are processed and the content is delivered to a user verbally in an IVB. Thus, call processing and text-to-speech technology are used to establish a telephone connection with a user and convert the active voice pages to speech for presentation to the user. As shown in FIG. 4, the IVB may be delivered to a user in many devices, including a telephone, a mobile phone, voice mail, an answering machine or any other voice-enabled device.

During the IVB, depending on the content that is being delivered, control may be passed to an e-commerce application for the user to complete a transaction based on the information presented. For example, if the user has requested information about sales on a particular brand of merchandise, the user may be connected with a particular retailer in order to complete a transaction to buy a particular good or service. Information about this transaction is then added to the databases and thus may be advantageously accessed by other users.

It may not be economical for some potential users of a voice broadcasting system to buy and/or maintain their own telephony hardware and software as embodied in call server 18. In such a case, a voice service bureau may be maintained at a remote location to service users voice service requests. A voice service bureau and a method of using a voice service bureau according to various embodiments of the present invention is described in conjunction with FIGS. 5-6.

In one embodiment, a voice service bureau may comprise one or more call servers and call databases that are centrally located and enable other voice service systems to generate a call request and pass the call request to the VSB to execute a call. In this way the other voice service systems do not need to invest in acquiring and maintaining call data bases, call servers, additional telephone lines and other equipment or software. Moreover, the VSB facilitates weeding out usage of illegal numbers and spamming by number checking implemented through its web server.

A voice service bureau and a method of using a voice service bureau according to one embodiment are described in conjunction with FIGS. 5-6. FIG. 5 depicts a method of utilizing a voice service bureau according to one embodiment of the present invention. The method begins in step 810 with a request to place one or more telephone calls received through a computer network.

According to one embodiment, the voice service bureau is maintained at a location distant from the voice service system. Therefore, in order for a voice service to be processed by the voice service bureau, in step 810 the voice service is sent to the voice services bureau, preferably over some secure line of communication. According to one embodiment, the request is sent to the voice service bureau through the Internet using secure HTTPS. HTTPS provides a secure exchange of data between clients and the voice service bureau using asymmetric encryption keys based on secure server certificates. In another embodiment, SSL HTTP protocol is used to send a call request to the voice service bureau. Both of these protocols help ensure that a secure channel of communication is maintained between the voice service system and the voice service bureau. Other security techniques may be used.

When a request for a call or telecast is received, by the VSB, the request is authenticated by the voice service bureau in step 820. According to one embodiment, the authenticity of the request is determined in at least two ways. First, it is determined whether or not the request was submitted from a server having a valid, active server certificate. More specifically, requests may be typically received via a stream of HTTPS data. Each such request originating from a server with a valid server certificate will include an embedded code (i.e., server certificate) that indicates the request is authentic. In addition to the use of server certificates, each request may also be authenticated using an identification number and password. Therefore, if the request submitted does not include a valid server certificate and does not identify a valid I.D./password combination, the request will not be processed. The step of authenticating also comprises performing any necessary decryption. According to one embodiment, any errors that are encountered in the process of decrypting or authenticating the call request are logged an error system and may be sent back to the administrator of the sending system. Other methods of authenticating the request are possible.

Each properly authenticated request is sent to a call server (step 830) and processed (step 840). According to one embodiment, the voice service bureau comprises a number of call servers. According to one embodiment, the calls are sent to a call database, and processed as set forth herein in conjunction with the explanation of call server 18.

One embodiment of a voice service bureau will now be explained in conjunction with FIGS. 6a-6c. FIG. 6a depicts a system comprising a plurality of client side installations 91, a primary voice bureau 92, a system administrator 93, a backup voice service bureau 94, and a plurality of users 95. Client side installations 91 communicate with voice service bureau 92 through a computer network. Voice service bureau 92 communicates with users 95 through a voice network. According to one embodiment, the computer network comprises the internet and client side installations 91 communicate with voice service bureau 92 using HTTPS as described above, and the voice network comprises a public telephone network.

According to one embodiment, client side installations 91 are substantially identical to the system shown in FIG. 4 except for the elimination of call server 18. In the system of FIG. 6a, the functionality of call server 18 is performed by VSB 92. As shown in this embodiment, VSB 92 can service multiple client side installations 91₁ to 91n. According to another embodiment, client-side installation functionality may be included within VSB 92. According to this embodiment VSB 92 constitutes a fully functional voice service that is accessible through email, telephone or other interfaces.

According to this embodiment, when voice services have been assembled by intelligence server 16, a request to have the voice services transmitted is sent via a secure network connection through the computer network shown to primary voice bureau 92 and backup voice service bureau 94 as described above. According to one embodiment, the request comprises a mark-up language string that contains the voice service structure and content and personal style properties and other information. As described above, voice bureau 92 authenticates the request, queues the voice services and sends telecasts to users 95 through the voice network.

A block diagram of one embodiment of primary voice bureau 92 is shown in FIG. 6b. According to this embodiment, primary voice bureau comprises routers 921, dual-homed servers 922, database servers 923, call database 924, backup storage 925, call servers 926, internal switch 927, and system administrator 928. Routers 921 receive call requests via a computer network and pass them along to one of the two dual-homed servers 922. Router 921 monitors activity on servers 922 and forwards call requests to one of the two depending on availability.

Dual-homed servers 922 comprise servers configured to receive and send HTTPS email. As part of their receiving function, dual-homed servers 922 are configured to perform the authentication processing described above. According to one embodiment, dual-homed servers 922 determine whether the incoming request originated from a server with an active server certificate and also determine if the request contains a valid I.D./password combination. Once dual-homed servers 922 have authenticated the incoming request, they forward the request to be queued in call database 924. As part of their sending function, dual-homed servers 922 are configured to format and send HTTPS email. As discussed above, during a telecast a user may request that further information be accessed from a database or that some transaction be performed. According to one embodiment, these user requests are forwarded back to the originating system via HTTPS email by dual-homed servers 922. Dual-homed servers 922 are load balanced to facilitate optimal performance and handling of incoming call requests.

Database servers 923, call database 924, and backup storage 925 together comprise a call request queuing system. Primary voice bureau 92 is configured to handle a large number of call requests. It may not be possible to process call requests as they arrive. Therefore, call requests are queued in call database 924. According to one embodiment, call database 924 comprises a relational database that maintains a queue of all call requests that need to be processed as well as logs of calls that have been processed. According to another embodiment, primary VSB 92 may include a failover measure that enables another system server to become the call database if call database 924 should fail.

Database servers 923 are configured to control access to call database 924. According to one embodiment, database servers may be optimized to generate SQL statements to access entries in call database at high speed. Database servers 923 also control storage of call requests and call logs in call database 924.

Call servers 926 each are configured to format and send telecasts. According to one embodiment, each of call servers 926 is substantially identical to call server 18 shown in FIG. 3c. More specifically, each of call servers 926 receives requests for telecasts, parses the call content from the mark-language, establishes a connection with the user through phone lines 929, and receives user responses. According to one embodiment, call servers 926 comprise a clustered architecture that facilitates message recovery in the event of server failure.

Primary voice bureau 92 is controlled by system administrator 93 and internal switch 927. System administrator controls switch 927 and thus controls the flow of call requests to call database 924 from dual homed servers 922 and to call servers 926 from call database 924.

System administrator 93 is also configured to perform a number of other services for primary voice bureau 92. According to one embodiment, system administrator 93 also comprises a billing module, a statistics module, a service module and a security module. The billing modules tabulates the number of voice service requests that come from a particular user and considers the billing plan that the customer uses so that the user may be appropriately billed for the use of voice bureau 92. The statistics module determines and maintains statistics about the number of call requests that are processed by voice bureau 92 and statistics regarding call completion such as, e.g., success, failed due to busy signal and failed due to invalid number. These statistics may be used, for example, to evaluate hardware requirements and modify pricing schemes. The security module monitors activity on voice bureau 92 to determine whether or not any unauthorized user has accessed or attempted to access the system. The service module provides an interface through which primary voice bureau 92 may be monitored, for example, to determine the status of call requests. Other service modules are possible. Moreover, although these services are described as distinct modules, their functionality could be combined and provided in a single module.

Backup voice service bureau 94 receives a redundant request for voice services. Backup voice service bureau 94 processes the requests only when primary voice service bureau is offline or busy. One embodiment of backup voice service bureau 94 is shown in FIG. 6c. Backup voice bureau 94 comprises routers 941, HTTP server 942, database server 943, call server 946 and routers 947. Each of these components performs a function identical to the corresponding element in primary voice bureau 92. Router 947 replaces switch 927. Router 947 controls the forwarding of call requests to database server 943 for queuing in an internal database, and the forwarding of call requests to call server 946 from database server 943.

The systems and methods discussed above are directed to outbound broadcasting of voice services. Nevertheless, in certain situations, for example when the out bound telecast is missed, it is desirable to for a voice service system to enable inbound calling. According to another embodiment, a method and system for providing integrated inbound and outbound voice services is disclosed.

A method for providing inbound access to voice services according to one embodiment of the present invention is shown in FIG. 7. According to FIG. 7, the method begins with receipt of a call requesting voice services in step 1210. To help ensure system integrity and to prevent unauthorized access, a call request is authenticated in step 1220. According to one embodiment, each incoming caller is automatically prompted to enter a login identifier and a PIN. According to another embodiment, an automatic number identification system is used, in addition to a login identifier and PIN system, to determine whether or not the user is calling from an authorized device. According to another embodiment, speaker recognition technology is utilized to identify a caller. According to this embodiment, voice prints for each user of the voice service system are stored as identifiers. When an inbound call is connected, pattern matching techniques are used verify the user's speech against the previously stored voice prints. Other security measures are possible.

In step 1230, a voice page is located. As explained above, a telecast of a voice service is driven by an active voice page. Accordingly, a user calling in to access voice services locates the desired active voice page. According to one embodiment, the user is automatically placed into an active voice page of a voice service that the user missed. That is, the system chooses an active voice page that it was unable to deliver. According to this embodiment, when a call is undeliverable (e.g., when an answering machine picks up), the active voice page for that call is placed in memory in a “voice site” table or as an active voice page on a web site and addressed using the user's identification. When the user calls in to retrieve the voice service, after the user logs in, the table or web site will be searched for an active voice page that corresponds to their identification. If such a page exists, it is executed by the call server.

Other possibilities exist for accessing active voice pages through inbound calling. According to another embodiment, the system maintains a log of all voice services sent and provides an inbound user an option to select one of their previous voice services. According to another embodiment, an inbound caller is automatically placed into an active voice page that presents the user with an option to select one of that user's most frequently used services. According to still another embodiment, the user is allowed to search for past active voice pages by date or content. For example, the user may be prompted to enter a date on or near which the desired voice page was executed. According to another embodiment, the user may use the telephone keys to enter a search term and search the content of any previously executed active voice page that they are authorized to access or that is not secure.

Once an active voice page is located, the user navigates through the active voice page in step 1240. As described above, a user navigates through an active voice by exercising options, responding to prompts and otherwise entering input to the system. An inbound calling system would thus have access to the full functionality of the voice service system described in conjunction with FIGS. 1-6.

FIG. 8 depicts a block diagram of a call server 18a that enables integrated inbound and outbound calling. In addition to the modules depicted in call server 18 of FIG. 3, call server 18a comprises call receiver module 1817, security module 1818 and search module 1819. Moreover, in the system for permitting inbound and outbound calling, call database 1811 has been replaced with an enhanced call database 1811a.

In order to receive inbound calls, call server 18a comprises call receiver module 1817. Although, call server 18 discussed above contains hardware permitting reception of calls as well as transmission of calls, it is not set up to receive calls. Call receiver module 1817 enables call server 18a to receive calls and routes the incoming calls to security module 1818. According to one embodiment, call receiver module comprises a software component designed to configure call server 18a to receive calls. Other embodiments are possible.

Received calls are forwarded to security module 1818 for authentication. According to one embodiment discussed above, incoming calls are authenticated using login I.D.'s and passwords. According to another embodiment, automatic number identification software is used to identify and authenticate callers. According to another embodiment, speech recognition and pattern matching techniques are used to identify a caller.

Authenticated calls may search for an active voice page using search module 1819. According to one embodiment, search module 1819 comprises a search engine designed specifically to search active voice pages. According to one embodiment discussed above, active voice pages utilize an XML-based language and search module 1819 comprises an XML-based search engine. According to another embodiment, search module 1819 comprises a SQL engine designed to make queries against a relational or other type of database.

The active voice pages that are being search are stored in enhanced call database 1811a. In addition to its facilities to queue and log calls, enhanced call database 1811 includes facilities to catalog active voice pages. According to one embodiment, enhanced call database comprises a relational or other type of database. According to this embodiment, enhanced call database is used to store and categorize active voice pages and corresponding parameters, such as expiration dates for active voice pages. Other storage facilities are possible.

Various features and functions of the present invention extend the capabilities of previously known information delivery systems. One such system is MicroStrategy's Broadcaster version 5.6. The features and functions of the present invention are usable in conjunction with Broadcaster and other information delivery systems or alone. Other products may be used with the various features and functions of the invention including, but not limited to, MicroStrategy's known product suite.

Other embodiments and uses of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The specification and examples should be considered exemplary only. The scope of the invention is only limited by the claims appended hereto.