2016-10-11

YIOOP can use Hadoop or Hypertable for Storage of Large volume of data ??? If not, how proceed YIOOP ???.

Hello.
Today, NoSQL Databases are increasingly used with Hadoop, CASSANDRA, and other mostly by Internet giants Google, Facebook, Twitter, etc.
I wonder if YIOOP can support Hadoop , Hypertable , CASSANDRA combined with its storage mechanism ???
If so, how to develop YIOOP Plugins ???
If not, how Yioop without using Hadoop or Hypertable for example, can index a very large volume of data or Hadoop because Hypertable could help to Stock and index of Large volumes of data ???
Thank you explain me please.
(Edited: 2016-10-11)
Hello. Today, NoSQL Databases are increasingly used with '''Hadoop, CASSANDRA, and other mostly by Internet giants Google, Facebook, Twitter, etc.''' I wonder if YIOOP can support '''Hadoop''', '''Hypertable''', '''CASSANDRA''' combined with its storage mechanism ??? If so, how to develop YIOOP Plugins ??? If not, how Yioop without using Hadoop or Hypertable for example, can index a very large volume of data or Hadoop because Hypertable could help '''to Stock and index of Large volumes of data ???''' Thank you explain me please.
2016-10-14

-- YIOOP can use Hadoop or Hypertable for Storage of Large volume of data ??? If not, how proceed YIOOP ???
Yioop does not support Hadoop, etc., nor is there any intention of future support for these products.
 
In my opinion the more outside dependencies a project has the harder it is to maintain and improve. The is especially important for the Yioop project as it only has a small number of developers. One of the design goals of Yioop was to make it as self-contained as possible and as close to a pure PHP project as possible.
 
Yioop uses its own indexing format and this has been shown to be able to store more than a billion pages. It can also read in several large scale formats such as WARC.
 
As I indicated in my response to your previous thread, explanations for creating Indexing Plugins are described on the Yioop documentation. If you have a specific question after looking at the documentation, I can try to provide an answer.
 
Best,
Chris
(Edited: 2016-10-14)
Yioop does not support Hadoop, etc., nor is there any intention of future support for these products. In my opinion the more outside dependencies a project has the harder it is to maintain and improve. The is especially important for the Yioop project as it only has a small number of developers. One of the design goals of Yioop was to make it as self-contained as possible and as close to a pure PHP project as possible. Yioop uses its own indexing format and this has been shown to be able to store more than a billion pages. It can also read in several large scale formats such as WARC. As I indicated in my response to your previous thread, explanations for creating Indexing Plugins are described on the Yioop documentation. If you have a specific question after looking at the documentation, I can try to provide an answer. Best, Chris

-- YIOOP can use Hadoop or Hypertable for Storage of Large volume of data ??? If not, how proceed YIOOP ???
Ok great thank you dear Chris but tell me please, how many Web servers YIOOP needs to store as many pages as Google ???
What are the characteristic of this number of servers ???
Thank you.
(Edited: 2016-10-15)
Ok great thank you dear Chris but tell me please, how many Web servers YIOOP needs to store as many pages as Google ??? What are the characteristic of this number of servers ??? Thank you.
X