Rezwan Ahmed & His Team || Software Engineer || CMS Developer | Contents Writer | Graphics Designer |

AdVANCED DaTABASE TeCHNOLOGY ::

Hierarchy of DATA ORGANIZATION


Hierarchy of DATA ORGANIZATION

Bit;
Character(Byte); 
Data Element  field;
Record;
File;
Database

 


Business Intelligence Tool


Business Intelligence Tool – BI tools essentially derive information from data. Since, enterprise data come in huge volumes, BI tools are used to get proper and timely insights from the data.

Using a BI tool requires multiple layers of interactions. For business executives to get information out of enterprise data, they need to go through IT people to place a request. The IT guys can take multiple days to comply with the requests and still deliver irrelevant information. Using a regular BI tool also requires technical programming language knowledge.

Data situation in Bangladesh?


Bangladesh is slowly heading towards automation. Once automation is fully complete, they can make the best out of data-driven decisions. There are a few companies that have digitalised themselves already.

But, the culture in our country is to make executive decisions based on intuition and experience, which is obviously not going to change overnight. BI has immense potential in the business process and can be a groundbreaking solution for handling data.


Grateful Thanks for to do Design, Database Interface Engine


software_explanation_rezwanahmed

On the last 28th August, 2015, I got ” Many Good Marks ” from the Chairman Sir of Asiatic, the President Sir of CanCham and the rest of Executive Director of CanCham for ” Design Database Interface Engine “

Absolutely, that’s my another one new job as an Application System Executive Support. Thanks To Allaah that gave me such type of position.

In addition, I’m achieving a great experience with Database Interface Design that more Interact with People, Focusing Behavior, Target Audience, Build Prototype, Analysis Business and Visual Design Experience.


Prototype Storage System


Prototype system at the Open Compute Project summit meeting in San Jose, California, noting that it’s intended to store data that rarely needs to be accessed.

The Prototype storage system consists of an ordinary looking cabinet with stacks of Blu-ray discs inside. A robotic picker plucks a disc from a pile and moves it to one of the 16 Blu-ray burners so that data can be written to it.


Structured Text Retrieval & Challenges


Structured Text Collection

Challenge 1 (Information/Doc Unit): What is an appropriate information unit?

– Document may no longer be the most natural unit
–  Components in a document or a whole Web site may be more appropriate
 
Challenge 2 (Query): What is an appropriate query language?
–  Keyword (free text) query is no longer the only choice
–  Constraints on the structures can be posed (e.g., search in a particular field or matching a URL domain)

 Challenge 3 (Retrieval Model): What is an appropriate model for STR?

–  Ranking vs. selection
  • Boolean model may be more powerful with structures (e.g., domain constraints in Web search)
  • But, ranking may still be desirable
–  Multiple (Potentially Conflicting) Preferences
  • Text-based ranking preferences (traditional IR)
  • Structure-based ranking preferences (e.g., PageRank)
  • Structure-based constraints (traditional DB)
  • Text-based constraints (e.g., )
  • How to combine them?

Typology of Web Search Engines


Typology of Web Search Engines

Yahoo: yahoo always uses the directory base search service and search for directories

Google: Google uses a search engine, then web index. Google uses spider or robot in web index.

Meta Engine: A search engine that queries other search engines and then combines the results that are received from all. In effect, the user is not using just one search engine but a combination of many search engines at once to optimize Web searching. For example, Dogpile is a Metasearch engine.

A meta-search engine is a search tool that sends user requests to several other search engines and/or databases and aggregates the results into a single list or displays them according to their source. Metasearch engines enable users to enter search criteria once and access several search engines simultaneously. Metasearch engines operate on the premise that the Web is too large for any one search engine to index it all and that more comprehensive search results can be obtained by combining the results from several search engines. This also may save the user from having to use multiple search engines separately.


Basic Search Engine Technologies |


18-websearch

Component I: Crawler/Spider/Robot

• Building a “toy crawler” is easy
   –Start with a set of “seed pages” in a priority queue
   –Fetch pages from the web
   –Parse  fetched pages for hyperlinks; add them to the queue
   –Follow the hyperlinks in the queue
• A real crawler is much more complicated…
   –Robustness (server failure, trap, etc.)
   –Crawling courtesy (server load balance, robot exclusion, etc.)
   –Handling file types (images, PDF files, etc.)
   –URL extensions (cgi script, internal references, etc.)
   –Recognize redundant pages (identical and duplicates)
   –Discover “hidden” URLs (e.g., truncated)

Crawling strategy is a main research topic 

Major Crawling Strategies

• Breadth-First (most common; balance server load)
• Parallel crawling
• Focused crawling
   –Targeting at a subset of pages (e.g., all pages about “automobiles” )
   –Typically given a query
• Incremental/repeated crawling
   –Can learn from the past experience
   –Probabilistic models are possible

Characteristics of Web Information


•“Infinite” size  (Surface vs. deep Web)
–Surface = static HTML pages
–Deep = dynamically generated HTML pages (DB)
•Semi-structured
–Structured = HTML tags, hyperlinks, etc
–Unstructured = Text
•Different format (pdf, word, ps, …)
•Multi-media (Textual, audio, images, …)
•High variances in quality (Many junks)
•“Universal” coverage (can be about any content)
•Information Access
–Search  (Search engines, e.g. Google)
–Navigation  (Browsers, e.g. IE)
–Filtering (Recommender systems, e.g., Amazon)
•Information Organization
–Categorization (Web directories, e.g., Yahoo!)
–Clustering (Organize search results, e.g., Vivsimo)

Dynamic Web Page| Data Features – How You Can Understand


Dynamic Webpage must should have some features, Such as Like

– HTML base
– Header
– Sequentially change the page and page elements
– Electronic Mail always should be incoming and outgoing
– Dynamic webpage has no unstructured database 
– Multimedia basis ( textual data, audio, video, image,…)
– Universal coverage (can be about any content)
– Structured data (HTML, tags, hyperlinks, etc..)
 
Above info discussion by Zahidur Rahman, Ph.D. | Dean, BRAC University