US20070124309A1
2007-05-31
11/355,343
2006-02-16
In a content retrieval system where an update frequency of content is extremely high, based on a content reference request from a client which generates the content reference request including unique information and an attribute of a desired content, a cache server checks a presence/absence of a cache of the content, caches the content from a content server to transmit the content to the client in the absence of the cache of the content, or transmits the content held to the client in the presence of the cache of the content. Then, the cache server performs synchronization mirroring with the content server based on the attribute.
Get notified when new applications in this technology area are published.
G06F16/9574 » CPC main
Information retrieval; Database structures therefor; File system structures therefor; Details of database functions independent of the retrieved data types; Retrieval from the web; Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
G06F7/00 IPC
Methods or arrangements for processing data by operating upon the order or content of the data handled
1. Field of the Invention
The present invention relates to a content retrieval system, and in particular to a system retrieving content by using a cache from a network.
2. Description of the Related Art
As technologies for reducing traffic flowing over a network, (1) a cache technology and (2) a mirroring technology exist. Both serve to copy information owned by a server having content (content server) to another location on the network near a reference requesting person (client), thereby making the client refer the copy to reduce the traffic of the content flowing over the network.
Among the above-mentioned technologies, (1) the cache technology is especially effective in a case where the content is not changed. However, cases have been recently increasing which can not be supported only by caching of the content such as a web server dynamically generating the content upon client's access.
In order to solve this, a technology of minutely separating the content, even if the content is dynamically generated as a whole, into dynamic portions and statistic portions, and increasing the ratio of the content which can be cached by cashing the portions other than the dynamic portions has been developed.
Also, as another approach, there is a technology of caching dynamic content, and increasing a hit rate of the cache by automatically updating the cache when the content is changed.
On the other hand, (2) the mirroring technology is suitable for a case where a large amount of data is copied at a fixed period.
Also, as other prior art technologies, there are a network server detecting a frequency with which cache data is accessed by a client terminal, notifying that the frequency has exceeded a prescribed frequency to a control circuit, and requesting a main server to read update data of the cache data based on a notification signal, and a data update method using the network server (see e.g. patent document 1).
Furthermore, there are a system and method for reducing a time to deliver information from a communication network to a user. In order to keep all data the user needs as close to the user as possible, user's characteristics and usage patterns are used to determine what to cache and for how long, what to pre-fetch, what to refresh, and what to retrieve. In addition, by segmenting information and utilizing parallel communication channels, a data transfer across the last mile can be significantly increased (see e.g. patent document 2).
[Patent Document 11 Japanese Patent Application Laid-open No. 2001-175527
[Patent Document 2] Japanese Translation of PCT International Application No. 2004-535631.
Although an update frequency of content is extremely high in the above-mentioned cache technology, the cache has not been effective in such a case where a reference request frequency by a client is low.
Also, in the mirroring technology, a requesting source's intention is not reflected during the period, so that there has been a problem that the reduction of the traffic can not be expected if the period is matched to the conceivably shortest period.
SUMMARY OF THE INVENTIONIt is accordingly an object of the present invention to provide a content retrieval system by which traffic flowing can be reduced by effectively utilizing a cache even when an update frequency of content is extremely high while a reference request frequency by a client is low.
The cache server may update information on the content server every time the above-mentioned cache server receives the information from the content server, and the content server may update information on the cache server every time the content server receives the information from the cache server.
It is to be noted that the above-mentioned attribute may comprise e.g. a lifetime of a cache and a reference desired interval thereof.
The content retrieval system according to the present invention can be configured by a network, schematically shown in FIG. 1, comprising clients 1 referring to content, a cache server 2, a content server 3 and applications 4 registering the content.
Hereinafter, the above-mentioned [1]-[7] will be described referring to FIGS. 2-8. It is to be noted that while matters not described in the claims are indicated, those matters are only examples.
[1] Content Referring Operation in the Absence of cash in Cache Server (Initial State) FIG. 2
It is to be noted that the content server 3 receives a content registration request independently of the above-mentioned operation from the content registration application 4 to register the content (at step T1 T11 and T12). This is applied to each operation example.
As a case where the cache update is effective in which the cache server takes an initiative, it can be mentioned satisfying the following condition
In this case, it is supposed that the content server performs no processing other than returning a response to the respective content synchronization request, thereby enabling a load of the content server to be reduced.
As a case where the cache update is effective in which the content server takes an initiative, it can be mentioned satisfying the following conditions
In these cases, the content server manages the transmitting destination and performs the cache notification. However, by using the multicast or the like, the number of cache notifications transmitted is reduced, thereby enabling the load of the content server to be reduced.
[5] Content Referring Operation when Content is Temporarily Unavailable in the Absence of Cache in Cache Server FIG. 6
As described above, according to the present invention, the client explicitly transmits the requirements concerning the cache to the cache server, thereby enabling the cache over the cache server to satisfy the request of the client. Therefore, even if the update frequency of the content is extremely high while a reference request frequency of the client is low, cache operations exceeding the requirement of the client are not performed, thereby enabling the cache to be effectively used and the traffic to be reduced.
Also, when the client retrieves the content, the client concurrently retrieves the location where the content exists (address of the server), and centralizes the information to be cached, thereby eliminating a redundant retrieval of the content.
BRIEF DESCRIPTION OF THE DRAWINGSThe above and other objects and advantages of the invention will be apparent upon consideration of the following detailed description, taken in conjunction with the accompanying drawings, in which the reference numerals refer to like parts throughout and in which
FIG. 1 is a block diagram showing a network arrangement to which a content retrieval system according to the present invention is applied;
FIG. 2 is a sequence diagram showing a principle [1] of a content retrieval system according to the present invention;
FIG. 3 is a sequence diagram showing a principle [2] of a content retrieval system according to the present invention;
FIG. 4 is a sequence diagram showing a principle [3] of a content retrieval system according to the present invention;
FIG. 5 is a sequence diagram showing a principle [4] of a content retrieval system according to the present invention;
FIG. 6 is a sequence diagram showing a principle [5] of a content retrieval system according to the present invention;
FIG. 7 is a sequence diagram showing a principle [6] of a content retrieval system according to the present invention;
FIG. 8 is a sequence diagram showing a principle [7] of a content retrieval system according to the present invention;
FIG. 9 is a block diagram showing an embodiment of a cache server used for a content retrieval system according to the present invention;
FIG. 10 is a block diagram showing an embodiment of a content server used for a content retrieval system according to the present invention;
FIG. 11 is a block diagram showing an embodiment of a client used for a content retrieval system according to the present invention;
FIG. 12 is a sequence diagram showing an operation example (1) of a cache server used for a content retrieval system according to the present invention;
FIG. 13 is a diagram showing an embodiment of a content reference request used for a content retrieval system according to the present invention;
FIG. 14 is a diagram showing an embodiment of a content synchronization request used for a content retrieval system according to the present invention;
FIG. 15 is a sequence diagram showing an operation example (2) of a cache server used for a content retrieval system according to the present invention;
FIG. 16 is a diagram showing an embodiment of a content synchronization response (normal response) used for a content retrieval system according to the present invention;
FIG. 17 is a diagram showing an embodiment of a content reference response (normal response) used for a content retrieval system according to the present invention;
FIG. 18 is a sequence diagram showing an operation example (3) of a cache server used for a content retrieval system according to the present invention;
FIG. 19 is a sequence diagram showing an operation example (4) of a cache server used for a content retrieval system according to the present invention;
FIG. 20 is a sequence diagram showing an operation example (5) of a cache server used for a content retrieval system according to the present invention;
FIG. 21 is a sequence diagram showing an operation example (6) of a cache server used for a content retrieval system according to the present invention;
FIG. 22 is a diagram showing an embodiment of a cache notification used for a content retrieval system according to the present invention;
FIG. 23 is a diagram showing an embodiment of a cache notification response used for a content retrieval system according to the present invention;
FIG. 24 is a sequence diagram showing an operation example (7) of a cache server used for a content retrieval system according to the present invention;
FIG. 25 is a diagram showing an embodiment of a content synchronization response (response of temporarily unavailable/unavailable) used for a content retrieval system according to the present invention;
FIG. 26 is a diagram showing an embodiment of a content reference response (response of temporarily unavailable/unavailable) used for a content retrieval system according to the present invention;
FIG. 27 is a sequence diagram showing an operation example (8) of a cache server used for a content retrieval system according to the present invention;
FIG. 28 is a sequence diagram showing an operation example (1) of a content server used for a content retrieval system according to the present invention;
FIG. 29 is a sequence diagram showing an operation example (2) of a content server used for a content retrieval system according to the present invention;
FIG. 30 is a sequence diagram showing an operation example (3) of a content server used for a content retrieval system according to the present invention;
FIG. 31 is a sequence diagram showing an operation example (4) of a content server used for a content retrieval system according to the present invention;
FIG. 32 is a sequence diagram showing an operation example (1) of a client used for a content retrieval system according to the present invention; and
FIG. 33 is a sequence diagram showing an operation example (2) of a client used for a content retrieval system according to the present invention.
DESCRIPTION OF THE EMBODIMENTSEach embodiment of the cache server 2, the content server 3, and the client 1 composing the content retrieval system according to the present invention will now be described.
Embodiment of Cache Server FIG. 9Communication Management Portion 21
This portion 21 receives a message addressed to the cache server 2, and distributes requests to each function required according to processing. If the message is associated with a cache, the communication management portion has a function of transferring the message to a cache controller 22. Also, receiving requests from each portion, the communication management portion 21 transmits the messages.
Cash Controller 22
This controller 22 has a function of determining processing required for each case triggered by the request from each portion, and distributing the processing to each portion.
Cash Information Management Portion 23
This portion 23 has a function of holding/managing content (URI) to be cached and an attribute (lifetime of cache, reference desired interval thereof, and the like see FIG. 13) requiring the content.
Content Server Information Management Portion 24
This portion 24 has a function of holding/managing content to be cached and information of a content server holding the original.
Cash Determining Portion 25
This portion 25 has a function of determining the content to be cached and the attribute thereof based on the request from the client 1. For example, the portion 25 has a function of determining an optimum compression method concerning a plurality of clients.
Embodiment of Content Server FIG. 10Communication Management Portion 31
This portion 31 receives a message addressed to the content server 3, and has the same function as the above-mentioned communication management portion 21.
Cache Controller 32
This controller 32 has the same function as the above-mentioned cache controller 22.
Content Management Portion 33
This portion 33 has a function of holding/managing the content registered/updated from the content registration application 4. It is to be noted that the content registration application 4 may be installed on the content server 3 itself, where the content is internally registered/updated.
Cash Server Information Management Portion 34
This portion 34 has a function of holding/managing the information of the cache server caching the content and the above-mentioned attribute.
Embodiment of Client FIG. 11Communication Management Portion 11
This portion 11 receives a message addressed to the client 1, and distributes requests to each portion required according to the processing. If the message is a response message of the cache request, the portion 11 has a function of transferring the message to a cache request controller 12. Also, the communication management portion 11 transmits the message when receiving a request from each portion.
Cache Request Controller 12
This controller 12 has a function of determining processing required for each case triggered by a request from each portion, and distributing processing to each function.
Application Management Portion 13
Since the cache server 2 determines the content to be cached and the attribute thereof, the application management portion 13 has a function of managing the attribute required for each application.
Hereinafter, operation embodiments of the cache server 2, the content server 3, and the client 1 will be described in this order.
Operation Example of Cache Server(1) Operation Example of Cache Server when having Received A cache Reference Request (In the Absence of Cache in Cache Server) FIGS. 12 and 2 (Dotted Line Portion (1))
(1) Operation Example of Content Server when having Received A Content Synchronization Request FIGS. 28 and 2 (One-Dot Chain Line Portion (1))
(1) Operation Example of Client when having Transmitted Content Reference Request FIGS. 32 and 2 (Two-Dot Chain Line Portion (1))
It is to be noted that the present invention is not limited by the above-mentioned embodiments, and that various modifications may be obviously made by one skilled in the art based on the recitation of the claims.
1. A content retrieval system comprising
a client generating a content reference request including unique information and an attribute of a desired content; and
a cache server checking, based on the content reference request from the client, a presence/absence of a cache of the content, transmitting to a content server a content synchronization request including the unique information and the attribute in the absence of the cache of the content, caching the content when the content is transmitted from the content server having received the content synchronization request, and performing synchronization mirroring with the content server based on the attribute after the cache server has transmitted the content to the client.
2. The content retrieval system as claimed in claim 1, wherein in the presence of the cache of the content, the cache server performs the synchronization mirroring with the content server based on the attribute after the cache server has transmitted the content held to the client.
3. The content retrieval system as claimed in claim 1, wherein for the synchronization mirroring, the cache server takes an initiative to detect a cache update based on the attribute and requests the cache update from the content server.
4. The content retrieval system as claimed in claim 2, wherein for the synchronization mirroring, the content server takes an initiative to detect a cache update based on the attribute and requests the cache update by transmitting a cache notification including the content to the cache server.
5. A content retrieval system comprising
a client generating a content reference request including unique information and an attribute of a desired content; and
a cache server checking, based on the content reference request from the client, a presence/absence of a cache of the content, transmitting to a content server a content synchronization request including the unique information and the attribute in the absence the cache of the content, and transmitting to the client a content reference response that the content is temporarily unavailable when the cache server receives a content synchronization response that the content is temporarily unavailable from the content server having received the content synchronization request.
6. A content retrieval system comprising
a client generating a content reference request including unique information and an attribute of a desired content; and
a cache server checking, based on the content reference request from the client, a presence/absence of a cache of the content, checking information of a content server held by the cache server itself in the absence of the cache of the content, and transmitting to the client, when the content server has found that the content is temporarily unavailable, a content reference response indicating that the content is temporarily unavailable.
7. The content retrieval system as claimed in claim 5, wherein when the content becomes available, the content server requests a cache update by transmitting a cache notification including the content to the cache server.
8. The content retrieval system as claimed in claim 1, wherein the cache server updates information on the content server every time the cache server receives the information from the content server, and the content server updates information on the cache server every time the content server receives the information from the cache server.
9. The content retrieval system as claimed in claim 1, wherein the attribute comprises a lifetime of a cache and a reference desired interval thereof.
10. The content retrieval system as claimed in claim 2, wherein the cache server updates information on the content server every time the cache server receives the information from the content server, and the content server updates information on the cache server every time the content server receives the information from the cache server.
11. The content retrieval system as claimed in claim 3, wherein the cache server updates information on the content server every time the cache server receives the information from the content server, and the content server updates information on the cache server every time the content server receives the information from the cache server.
12. The content retrieval system as claimed in claim 4, wherein the cache server updates information on the content server every time the cache server receives the information from the content server, and the content server updates information on the cache server every time the content server receives the information from the cache server.
13. The content retrieval system as claimed in claim 5, wherein the cache server updates information on the content server every time the cache server receives the information from the content server, and the content server updates information on the cache server every time the content server receives the information from the cache server.
14. The content retrieval system as claimed in claim 6, wherein the cache server updates information on the content server every time the cache server receives the information from the content server, and the content server updates information on the cache server every time the content server receives the information from the cache server.
15. The content retrieval system as claimed in claim 7, wherein the cache server updates information on the content server every time the cache server receives the information from the content server, and the content server updates information on the cache server every time the content server receives the information from the cache server.
16. The content retrieval system as claimed in claim 2, wherein the attribute comprises a lifetime of a cache and a reference desired interval thereof.
17. The content retrieval system as claimed in claim 3, wherein the attribute comprises a lifetime of a cache and a reference desired interval thereof.
18. The content retrieval system as claimed in claim 4, wherein the attribute comprises a lifetime of a cache and a reference desired interval thereof.
19. The content retrieval system as claimed in claim 5, wherein the attribute comprises a lifetime of a cache and a reference desired interval thereof.
20. The content retrieval system as claimed in claim 6, wherein the attribute comprises a lifetime of a cache and a reference desired interval thereof.